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EXECUTIVE  SUMMARY 


The  objective  of  this  project  was  to  provide  the  US  Environmental 
Protection  Agency  (EPA)  data  necessary  for  nationwide  approval  of  the 
FACTS  test  procedure  for  determining  free  available  chlorine  for  "National 
Interim  Primary  Drinking  Water  Regulations"  (NIPDWR)  corrpliance 
monitoring.  Based  on  the  minimun  requirement  for  NIPDWR  nationwide 
approval  comparability  testing,  a  detailed  protocol  was  developed  and 
testing  conducted. 

In  all,  16  water  treatment  plants  cooperated  in  the  equivalency 
testing.  Ten  oonpared  the  FACTS  test  to  the  DPD,  and  six  compared  the 
FACTS  test  to  the  anperometric  titration.  The  range  of  concentrations 
obtained  for  the  FACTS  and  DPD  comparison  was  from  0.4  to  2.3  mg/L  as 
CI2;  the  range  for  the  FACTS  and  anperometric  titration  comparison  was 
from  0.55  to  2.7  mg/L  as  Cl2*  At  most  treatment  plants  a 
prechlorination  and  postchlorination  site  were  used  in  the  testing. 

Sixty  samples  were  analyzed  at  each  plant,  yielding  192  data  points 
per  plant.  Forty-eight  of  these  samples  were  paired  comparisons  of  the 
FACTS  with  either  the  DPD  or  anperometric  titration.  The  paired 
comparisons  were  randomly  assigned  to  two  operators,  at  two  sites  (where 
possible)  for  each  plant.  For  the  remaining  twelve  samples,  six  for  each 
operator,  four  replicate  analyses  were  run  using  each  method. 

The  data  summary  for  the  comparison  between  FACTS  and  DPD  is  shown  in 
Figure  1  and  in  for  the  comparison  between  the  FACTS  and  anperometric 
titration  in  Figure  2. 

No  statistical  difference  was  observed  in  the  analysis  of  the  suimary 
data.  Results  are  summarized  in  the  report  for  the  individual  water 
treatment  plants.  The  report  details  the  results  for  the  eonparison  of 
FACTS  and  DPD,  and  of  FACTS  and  anperometric  titration. 

As  a  result  of  these  tests  the  EPA  has  approved  the  FACTS  test 
procedure  for  compliance  monitoring  of  free  available  chlorine  at  water 
treatment  plants. 

It  is  recommended  that  the  US  Army  review  the  requirements  for  a  free 
available  chlorine  test  for  field  use.  Consideration  should  be  given  to 
adopting  the  FACTS  test  procedure  for  field  Army  use,  because  of  its 
superior  specificity  for  free  chlorine,  its  equivalency  to  the  presently 
used  DPD  test,  and  its  availability  in  test  kit  form. 

In  addition  to  the  protocol  development  and  equivalency  testing  of 
the  FACTS  test  procedure,  a  study  was  conducted  to  conpare  several 
instrumental  methods  for  determining  chlorine  in  drinking  water.  It  was 
concluded  that  the  total  chlorine  analyzer  was  analyst  independent  and  is 
capable  of  monitoring  chlorine  continuously.  This  has  potential 
applications  in  water  purification  units  where  chlorine  is  added  as  the 
disinfectant  and  can  be  used  to  monitor  and  control  chlorine. 


FACTS  (mg/L  as  Cl2) 


Ccrpariscn  of  Means  for  FACTS  and  DPD  Test  Procedures  for 
Free  Available  Chlorine  Obtained  at  Ten  Water  Treatment  Plants 
Reprinted  from  JOURNAL  AWWA,  Vol.  75,  No. 12 
(December  1983),  by  permission.  Copyright®  1983, 

The  American  Water  Works  Association. 
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INTRODUCTION 


Chlorine  is  used  in  water  and  wastewater  treatment  for  various 
purposes.  Of  these  uses,  the  most  common  are  taste  and  odor  control, 
color  removal,  and  disinfection  in  drinking  water,  and  disinfection  in 
wastewater  treatment. 

There  are  numerous  methods  for  determining  chlorine  residuals  in 
aqueous  solutions  (1,2).  Briefly,  these  include  the  iodometric  titration, 
amperometric  titration,  and  several  colorimetric  procedures.  The 
iodometric  titration  is  limited  to  total  residuals  above  1  mg/L  as  Cl2« 

The  amperometric  titration  is  capable  of  differentiating  free  chlorine 
(H0C1/0C1-) ,  monochloramine  (NH^Cl ) ,  and  dichloramine  (NHCI2)  and  is 
generally  the  method  of  choice  in  the  laboratory.  Field  measurements  are 
limited  by  the  complexity  of  the  instrumentation.  The  colorimetric 
determinations,  which  find  application  in  both  the  laboratory  and  the 
field  are  the  DPD  (N,N-diethyl-p-phenylenediamine) ,  LCV  (leuoo  crystal 
violet)  and  FACTS  (free  available  chlorine  test  with  syringaldazine) 
procedures. 

More  recently  an  electrode  method  has  been  published  which  was 
reported  to  be  selective  for  H0C1  (3). 

All  test  procedures  used  for  National  Interim  Primary  Drinking  Water 
Regulation  (NIPEWR)  oorrplianoe  monitoring  must  be  approved  by  the  U.S. 
Environmental  Protection  Agency  (4).  Collaborative  testing  of  each 
procedure  is  required  for  inclusion  in  Annual  Bock  of  Standards,  Part  31, 
Water,  of  American  Society  for  Testing  and  Materials  (ASTM)  (2),  and 
Standard  Methods  for  the  Examination  of  Water  and  Wastewater  (Standard 
Methods )  ( 1 ) . 

The  U.S.  Army  Medical  Bioengineering  Research  and  Development 
Laboratory  has  been  involved  in  the  evaluation  of  chlorine  residual  test 
procedures  and  the  development  of  a  colorimetric  test  for  chlorine 
residuals,  FACTS,  free  available  £hlorine  test  with  syringaldazine.  It 
has  been  shown  that  the  FACTS  test  procedure  is  mere  specific  for  free 
chlorine  in  the  presence  of  common  interferences,  NH2CI,  NHCl2f 
Mn+4  and  Fe+^  than  is  DPD  (5-15).  However,  prior  to  this  research 
the  FACTS  procedure  had  not  been  approved  by  EPA  for  use  in  drinking  water 
and  had  never  been  subjected  to  an  extensive  collaborative  conparison. 

This  report  presents  the  results  of  the  conparison  of  the  FACTS  test 
procedure  and  the  approved  standard  test,  DPD.  Data  are  also  included 
showing  the  conparison  of  the  FACTS  test  procedure  with  anperometric 
titration. 


OBJECTIVES 

1 .  To  conpare  several  instrumental  methods  for  determining  chlorine 
residuals  in  drinking  water. 

2.  Tb  develop  a  detailed  protocol  for  equivalency  testing  of  methods 
for  drinking  water. 

3.  To  obtain  equivalency  test  data  from  a  minimum  of  six  water 
treatment  plants  using  the  FACTS  test  kit  procedure  and 
approved  methods. 


METHODS  AND  MATERIALS 


The  instrumental  methods  that  were  conpared  are  described  in  detail 
in  Appendix  A.  A  detailed  discription  of  the  methods  and  material  used 
in  this  study  are  provided  in  the  Appendices.  The  main  objective  of 
study  was  to  compare  the  FACTS  test  procedure,  the  FACTS®  test  kit  was 
the  HI  FACTS  Test  Kit  for  Measuring  Free  Available  Chlorine,  obtained 
from  Ames  Division,  Miles  Laboratories,  Inc.,  P.0.  Box  70,  Elkhart, 
Indiana  46515.  The  DPD  or  anperometric  procedure  normally  used  at  each 
plant  participating  in  this  comparison  served  as  the  standard  test 
procedure. 

RESULTS  AND  DISCUSSION 

As  a  portion  of  our  overall  evaluation  of  chlorine  test  procedures, 
several  instrumental  methods  for  determining  chlorine  residuals  in 
drinking  water  were  evaluated.  The  results  of  this  experimentation  have 
been  published  and  are  detailed  in  Appendix  A  (16). 

A  detailed  research  protocol  was  developed,  which  when  followed 
provides  sufficient  data  for  the  comparison  of  analytical  procedures  for 
determining  free  chlorine  in  aqueous  samples.  This  protocol  has  been 
published  and  is  reproduce  in  Appendix  B  (17). 

The  experimented  design  (17)  was  tested  using  the  FACTS,  DPD  and 
anperometric  test  procedures.  Ten  water  treatment  laboratories  part¬ 
icipated  in  the  comparison  of  the  FACTS  and  DPD,  and  six  laboratories 
participated  in  the  comparison  of  the  FACTS  and  the  anperometric 
titration.  The  results  have  been  published.  Appendix  C  (18),  and  the 
FACTS  test  has  been  approved  as  an  alternate  test  procedure  for 
determining  free  chlorine,  Appendix  D. 

A  study  has  recently  been  reported  that  details  the  kinetics  of 
mono chloramine  oxidation  of  DPD  (19)  and  confirms  the  previous  studies 
(5-13).  From  the  kinetic  expressions  it  was  shown  that  the 
monochloramine  interference  with  the  DPD  test  is  dependent  in  pH, 
monochloramine  and  DPD  concentration.  An  average  of  5.8  percent  per 
minute  interference  was  calculated  for  the  DPD  colorimetric  test  as 
described  in  Standard  Methods  ( 1 ) . 

CONCLUSIONS 

The  objectives  of  this  project  were  achieved.  A  detailed  protocol 
was  developed  that  can  be  used  for  conparison  testing  of  new  water 
quality  test  procedures.  This  test  plan  was  designed  to  meet  the  minimum 
requirements  of  the  USEPA  for  equivalency  testing  of  new  methods  for 
compliance  monitoring. 

Subsequent  to  the  protocol  development,  an  extensive  test  of  the 
FACTS  test  was  conducted  at  16  water  treatment  plants.  From  the  results 
of  these  tests  it  was  shown  that  the  FACTS  test  was  equivalent  to  the  DPD 
test  and  the  anperometric  titration  procedure.  The  test  also  demonstrat¬ 
ed  that  the  FACTS  test  kit  procedure  had  precision  equal  to  the  DPD  test 
procedure. 


In  conclusion  the  FACTS  test  has  been  shown  to  be  equivalent  to  the 
DPD  test.  The  FACTS  test  procedure  is  more  specific  for  free  chlorine  that 
the  DPD  test  presently  authorized.  Therefore,  hhen  chlorine  is  the  only 
treatment  of  hater  prior  to  consumption,  e.g.  field  .Army  operations,  the 
FACTS  test  for  free  chlorine  is  superior  to  the  DPD  test  procedure. 

RECOMMENDATIONS 

1 .  An  evaluation  of  the  present  Amy  standard  procedure  for  determining 
available  chlorine  for  the  field  Army  should  be  initiated. 

2.  The  FACTS  test  procedure  should  be  considered  as  a  replacement  for  the 
Army  standard  procedure  for  free  available  chlorine  for  field  Army. 
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Comparison  of  several  instrumental 
'  methods  for  determining  chlorine 
residuals  in  drinking  water 

William  J.  Cooper,  M.F.  Mehran,  R.A.  Slifker,  D.A.  Smith.  J.T.  Villate. 
and  P.H.  Gibbs 


The  authors  evaluated  four  methods  for  determining  chlorine  residuals  in  water.  Two 
membrane  electrodes,  a  potentfometrfc  electrode,  and  a  continuous  total  chlorine 
analyser  were  used  by  analysts  to  measure  free  or  total  chlorine  in  quality  assurance 
samples  and  In  tap  water  samples.  Amperometrtc  titration  was  used  as  a  referee 
method.  The  statistical  analyses  of  the  evaluations  are  presented  in  this  paper.  Average 
precision  o!  all  analysts  and  of  Individual  analysts  is  considered  for  each  method. 


The  realization  that  the  use  of  chlorine 
can  produce  halogenated  organic  com¬ 
pounds  in  drinking  water  has  emphasis 
on  research  regarding  the  chlorination 
process.  ’**  This  increased  emphasis  has 
also  resulted  in  additional  studies  of  the 
analytical  determination  of  active  chlo¬ 
rine  in  aqueous  solutions.  Numerous 
methods  for  the  determination  of  hypo- 
chlorous  acid,  hypochlorite  ion.  mono¬ 
chloramine,  dichloramine,  and  nitrogen 
trichloride  (HOC1.  OCI\  NHjCl.  NHC12. 
and  NCIj)  have  been  presented  in  Stan¬ 
dard  Methods1  and  evaluated  else¬ 
where.*'9  New  methods  utilizing  mem¬ 
brane  electrodes,  which  are  reported  to 
differentiate  between  HOC1  and  OCT.’0*12 
have  been  developed.  Potentiometric 
electrodes'1  and  an  automated  ampero- 
metric  method1* 15  also  may  be  used  in  the 
analysis  of  total  residual  chlorine.  The 
objective  of  this  study  was  to  evaluate 
two  membrane  electrodes,  a  potantiomet- 
ric  electrode,  and  a  total  chlorine  analyzer 
for  determining  chlorine  residuals  in 
wafer. 

Experimental  procedures 
Membrane  electrodes.  Two  membrane 
amperometric  electrodes,  obtained  from 
different  manufacturers,  were  tested.  The 
manufacturers'  operating  instructions 
were  followed.  When  not  being  used,  the 
electrodes  were  capped  to  protect  the 
membrane.  The  meters  were  connected  to 


a  110-V  power  source,  with  the  electrode 
attached  to  the  meter  at  all  times  to 
maintain  stability.  Calibration  was 
checked  daily  by  preparing  a  solution  of 
acetate  buffered  (pH  4)  HOC1.  (The  chlo¬ 
rine  solutions  were  prepared  by  diluting 
reagent  grade  sodium  hypochlorite.  The 
buffer  solution  was  prepared  by  diluting 
146  g  sodium  acetate  and  480  g  acetic  acid 
to  1  L)  The  concentration  of  HOC1  was 
determined  by  amperometric  titration. 

The  specific  operating  directions  for 
the  membrane  electrodes  were  as  follows: 

•  Membrane  electrode  A* 

1.  Determine  the  pH  of  the  sample. 

2.  Place  ISO  mL  of  the  sample  in  a  180- 
mL.  tall  form  beaker,  and  place  the  beaker 
on  a  magnetic  stirrer.  (Shake  the  electrode 
to  dislodge  air  bubbles  when  placing  it  in 
the  test  solution.) 

3.  Lower  the  electrode  into  the  sample 
until  it  almost  touches  the  bottom  of  the 
beaker,  and  turn  on  the  stirrer  (a  stirring 
bar  is  built  into  the  electrode) 

4.  Take  a  reading  on  the  appropriate 
scale— 0-1,  0-5,  or  0-10  mg  Cl2-L. 

5.  Calculate  the  actual  free  chlorine  by 
using  the  following  equation: 

k,  .jjnjocn  m 

(HOClj 

for  which  K,  =  2.0*  10  *  at  0°C  or  K,  *  3.3 
*  10'"  at  20°C.  For  example,  for  a  lem- 
peratureof  20°Cand  a  pH  of  7.0.  then  K .  = 
3.3  x  iO'"and  [H *)  =  1  x  10  ' M.  If  |HOCI] 


-  1.0  mg  L,  then  by  substitution  into  and 
rearrangement  of  Eq  1.  one  can  determine 
the  value  of  [OC1*] 

{rtrr]  1(3.3  x  10'*)  [1.0) 

J  *  w-' 

=  0.33  mg  L 

Therefore,  the  free  available  chlorine  is 
(HOC)}  +  [OC)-J  =  1.0m8  L-0.33mg  L  = 
1.33  mg/L. 

•  Membrane  electrode  B+ 

1.  Determine  the  pH  of  the  sample. 

2.  Place  400  mL  of  the  sample  in  a  600- 
mL  beaker. 

3.  Place  the  beaker  on  a  magnetic 
stirrer,  and  insert  the  electrode  into  the 
sample,  making  sure  there  are  no  bubbles 
on  the  membrane. 

4.  Take  a  reading  on  the  appropriate 
scale— 0-1  or  0-5  mg  Cl2  L. 

5.  Calculate  the  actual  free  chlorine  by 
using  Eq  1. 

Pofnttenwtrtc  electrode.  The  potentio- 
metric  electrode}  can  measure  only  total 
chlorine.  The  electrode  was  calibrated 
daily  as  follows: 

1.  Pipet  0.20. 1.00.  2.00.  and  2.50  mL  of 
0.00261N  iodate  standard  into  100-mL 
volumetric  flasks.  (The  standard  was 
prepared  by  dissolving  1.005  g  of  potas¬ 
sium  iodate  and  diluting  it  to  1  L.) 

2.  Add  5  mL  of  an  iodide  solution  (10 
percent  potassium  iodide  (KI|)  and  l  mL 
of  acetate  buffer  (pH  4)  to  each  flask  and 
to  a  flask  containing  no  iodate  (blank) 
Swirl  the  flasks  to  mix  the  solutions,  and 
let  the  solutions  stand  for  5  i  0  5  min. 

3.  Dilute  each  standard  to  the  100-mL 
mark,  then  mix  and  pour  the  solution  into 
a  150-mL  Erienmever  flask.  These  solu- 
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TABLE  1 

Descriptive  statistics  of  the  test  procedures  used  in  analyzing  the  total  chlorine  content  of 


Total  Chloric#  Analyzer 

7~]  !  »SD  I  » 


"Th#  m««n 

•The  aiandard  deviation 
:Th#  raianva  itandard  davienc 
$The  lumbar  of  observation! 


Amperometnc  Titrator  | 

** 

tf 

RSDf 

0  40 

0013 

3-3 

12 

0  92 

0  022 

2.4 

12 

1  28 

0  023 

1  a 

12 

1  29 

0  019 

15 

12 

0  36  0  DM  IS. 6 

0.93  0  093  10  2 

12«  I  0  19  12  ? 

I  21  I  0  14  tie 


0  42  0  0030  07  |  12 

0  94  0  049  0  3  [  12 

130  0  013  1  0  1  12 

1  39  0  0070  oe  I  12 


TABLE  2 

Summary  of  the  calculated  t-statistic.  adjusted  degrees  of  freedom,  and  voiue  nf  the  95 
percent  level  t-distribution  used  for  comparing  data  from  Table  I* 


Amperornttnc  Titrator  \  •ram  Amperomainc  Tiiralor  V#mu»  i  Potent  toneme  Electrode  Venue 
Pottaiiom+mc  EJecfrodr  Total  Chlonne  Analyzer  I  Total  Chlonn#  Analyzer 


Semple 

— 

ADP* 

Calculated 

1  i 

1  Companion  i 

ADP 

Calculated 

Companion  1 

ADP 

Calculated 

I  Companion 

1 

n  d  : 

1  13 

NCI 

12 

3  19 

2.78  ‘ 

N  D 

2  31 

NC 

2 

NO 

0  38 

NC 

12 

J  07 

2  ’8  ! 

N  0 

0  36 

N  C 

3 

N  D 

1 

N  C. 

17 

5  24 

2  68  1 

N  0 

0  68 

i  NC 

4 

VO.  j 

l— if 

NC. 

14 

10  16 

2  7« 

12 

1 43  ; 

1 

'Sunitical  ngnific  anc*  is  indicated  when  ih*  calculated  t -statistic  is  greater  than  the  value  »  burned  I  mm  the  i -distribution 
4>  the  appropriate  decrees  of  freedom  i comparison! 

•Adiui'ed  decrees  of  freedom 
:\ol  determined. 

iNoi  calculated,  for  a  comparison  of  'hree  lest  procedures  anv  calculated  t -statistic  irss  man  2  60  at  22  decrees  of  freedom  is 
nnt  sumficani  and  ihereforc  no  calculation  was  necessary 


TABLE  3 

Summary  of  single  analyst  statistics  and  relative  standard  deviation  for  test  procedures 
used  in  analyzing  quality  assurance  samples  prepared  with  chlorine-demand  free  water 

|  j  Amperometnc  Titrator  j  Potent lometric  Electrode  I  Total  Chlorine  Analyzer 

Sample  [  Analyst  [  7*  I  *♦  '  RSDt  J  7  1  v  1  RSD  :  T  1  >  1  RSD 

-  I  ■  ■— i-  1 - 1 - - - - - 

1  1  '  040  !  0012  3  1  I  042  :  0  0  1  0  42  00013  0  4 

2  040  ««*•  |  0  42  .  0  0  0  42  0  0012  0  3 


0  9  I  III 
11  1  32 


I  29  0  OOJ 

I  34  •  0  004 

1  3«  :  0 

1331  0  0006 


'The  uartdard  deviation 
;The  -elaiive  standard  Jevia 


TABLE  4 

Descriptive  statistics  of  test  procedures  used  in  analyzing  the  free  chlorine  content 
nf  tap  water  samples 

hmperrimeiru  Membrane  3rui»*'-mr*rti'  Memririne 

|  Amperometnc  Titraior  I  Klartrni*#  A  I  Hei  ••••»•  B 

Sample  ‘  7 *  1  i* -  RSD;  ;  7  »  .  »SO  n  7  I  »  USD  " 

3  .  I  03  0036  •  J  8  ;  It  ,  0  3’  (  0043  12  2  '2  0  23  0.0  4J  3  T, 

4  1  !  09  I  0  026  I  2  4'  12  1  0  29  i  0 034  1  : 1  ’  .  •  24  1  0  0*«  1  12  3  ■ 

0  40  l)  n32  4  0  12  .1  IS  0  013  9  4  12  I'*  <1  03'  .14  ■ 

4  0  87  0  019  2.  !2  0  14  0023  *  9  '2  *3  t  *  1  044  24.  1, 

"The  mean 

*  The  vrandard  levietion 
;  The  -e, aii^e  lundirl  deviation 
iThf  lumber  if  >oe»rv  al.oni 


tions  are  the  equivalent  of  0.20. 1  00, 2.00. 
and  2.S0  mg  Clj/L. 

4.  Stir  each  solution  at  30-60  rpm  with 
a  magnetic  stirrer,  immerse  the  electrode 
into  the  solution,  and  read  the  millivolts 
(positive)  after  30  s. 

5-  To  obtain  a  calibration  curve  plot 
millivolts  versus  log  chlorine  concentra¬ 
tion  (mg  ClrL). 

To  determine  the  total  chlorine  content 
of  the  samples,  the  procedure  was  as 
follows: 

1.  Add  5  mL  of  an  iodide  solution  (10 
percent  al)  and  1  mL  of  the  acetate  buffer 
(pH  4)  to  a  100-mL  volumetric  flask. 

2-  Fill  the  volumetric  flask  to  the  mark 
with  the  sample. 

3.  Stopper  the  flask,  and  mix  the 
sample  and  reagents  by  inverting  the 
flask  five  times.  Let  the  solution  stand  for 
5  z  O.S  min. 

4.  Pour  the  solution  into  an  Erlenmeyer 
flask,  and  stir  at  30-60  rpm  with  a  mag¬ 
netic  stirrer.  Immerse  the  electrode  into 
the  solution,  and  read  the  millivolts 
(positive)  after  30  s. 

5.  Read  the  concentration  from  the 
calibration  curve. 

Continuous  total  chlorine  analyzer.*  The 

manufacturer’s  operating  procedures 
were  followed.  The  instrument  was  zeroed 
and  then  calibrated  by  depressing  the 
appropriate  range  button  and  adjusting  a 
multiturn  potentiometer  to  give  the  ap¬ 
propriate  value. 

Samples  were  poured  into  400-mL 
beakers.  After  the  instrument  was  cal¬ 
ibrated.  the  samples  were  analyzed  for 
their  total  chlorine  content  Readings 
were  taken  from  the  digital  display  of  the 
analyzer. 

Experimental  design 

Two  different  types  of  water  sam¬ 
ples— quality  assurance  samples  and  tap 
water  samples— were  used  to  test  the 
procedures.  Quality  assurance  samples 
were  obtained  from  the  US  Environmental 
Protection  Agency.  Four  of  these  samples 
(8  mL  diluted  to  l  L  with  chlonne-de- 
mand-free  water)  were  tested.  Tap  water 
samples  were  obtained  after  allowing  the 
water  to  run  5-10  min.  Four  tap  water 
samples  were  tested. 

For  each  sample,  there  were  four  an¬ 
alysts  and  four  test  procedures.  Analysts 
were  randomly  assigned  test  procedures, 
and  samples  were  presented  blind.  Each 
sample  was  broken  down  into  four  sets, 
one  for  each  analyst-procedure  combina¬ 
tion.  For  each  set  tested,  the  analyst  was 
instructed  to  run  triplicates.  Therefore, 
the  total  number  of  observations  for  any¬ 
one  sample  was  48  (4  '  4  <  3  =  48| 

The  referee  method  was  amperometnc 
’itration  For  this  method  an  automatic 
i  titrator*  w-*s  used.  Fur  each  sample  set. 
tnplirate  analyses  were  performed 
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R **utts  and  discussion 
Statistics!  analysis.  A  total  oi  eight  sam¬ 
ples  was  used.  Each  sample  was  analyzed 
in  a  similar  manner.  For  each  test  proce¬ 
dure-sample  combination,  there  were  12 
measurements,  i.e..  four  analysts  reading 
triplicates  Onh  one  analyst  used  the 
referee  procedure— amperometric  titra¬ 
tion.  For  all  of  the  procedures,  descriptive 
statistics— mean.  *.  and  standard  devia¬ 
tion.  s— were  obtained.  For  the  statistical 
tests,  independence  of  all  measurements 
was  assumed  (If  the  three  measurements 
obtained  by  each  analyst  for  each  sample 
cannot  be  assumed  to  be  independently 
obtained  values  then  the  triplicates 
should  be  a\  erased  and  the  average  value 
should  be  used  in  the  statistical  analysis.) 
The  sample  means  were  compared  quan¬ 
titatively  by  computing  the  t-statistic: 

V  -  X: 

1  /ii  *  L  121 

>/  n.  n; 

w  here  \  and  x,  represent  the  means  of 
the  samples  of  interest.  s.J  and  s2:  were 
the  variances  of  the  respective  samples, 
and  n  and  n  were  the  number  of  observa¬ 
tions.  i.e..  measurements,  for  each  sample. 
Homogeneous  variances  between  samples 
were  assumed  for  the  computation  and 
comparison  of  the  f-statistic  for  any  given 
level  of  significance  and  any  number  of 
degrees  of  freedom.  The  results  from 
these  experiments  indicated  that  there 
was  considerable  variability  among 
variances  of  the  procedures,  i.e..  hetero¬ 
geneity.  Therefore,  the  number  of  the 
adjusted  degrees  of  freedom  (ADF)  for 
the  t-statistic  was  computed  for  each 
comparison  of  interest  by  using  the 
Satterthwaite  approximation: 


n.  -  l  n.  -  1 


where  v  =  s;:  n..  w  =  s;:  n2.  u  =  v  w,  and 
n  =  the  number  of  observations.1* 

The  Bonferroni  procedure  was  used  to 
adjust  for  multiple  comparisons.17  This 
procedure  determines  the  level  of  signif¬ 
icance  for  each  pairwise  comparison  by 
dividing  theoverall  o  level  by  the  number 
of  comparisons  made  on  each  sample. 
Therefore,  for  comparisons  of  three  sam¬ 
ple  means  at  the  overall  95  percent 
confidence  level,  the  t-statistic  chosen  for 
each  pairwise  comparison  is  that  of  a  = 
0.017  and  the  appropriate  number  of 
adjusted  degrees  of  freedom.  Several 
examples  of  the  statistical  calculations 
are  included  in  the  appendix. 

Quality  aaaurtnci.  Precision  of  all  an¬ 
alysts  A  summary  of  the  data  obtained 
for  the  four  quality  assurance  samples  is 
provided  in  Table  1.  (These  samples  were 
unbuffered,  and  the  membrane-covered 
amperometric  electrodes  did  not iuiuAion 
properly.  These  samples  should  be  buf¬ 
fered  to  obtain  standard  data.)  Compar¬ 


isons  of  the  results  from  the  amperometric 
titrator  with  those  from  the  potentiomet- 
nc  electrode  showed  that  no  statistical 
difference  existed  between  the  mpans  of 
the  samples  at  the  95  percent  level  of 
confidence  (Table  2).  The  precision  of  all 
analysts  who  used  the  potentiometric 
electrode  was  significantly  less  (greater 
spread)  than  the  precision  of  the  one 
analyst  who  used  the  amperometric  ti- 
trator.  This  was  not  unexpected  because 
an  individual  analyst's  precision  is  gen¬ 
erally  better  than  the  precision  of  a  group 
of  analysts. 

The  mean  of  the  results  obtained  with 
the  amperometric  titrator  was  lower  than 
that  obtained  with  the  total  chlorine 
analyzer.  This  difference  was  statistically 
significant  at  the  95  percent  level  of 
confidence  for  all  samples  (Table  2). 
However,  the  means  were  never  different 
by  more  than  0.06  mg  Cl2/  L.  The  precision 
of  all  analysts  who  used  the  total  chlorine 
analyzer  was  better  than  the  precision  of 
one  analyst  who  used  the  amperometric 
titrator  Because  the  precision  obtained 
with  both  test  procedures  was  good, 
statistical  differences  were  observed  with 
very  small  absolute  differences  in  the  two 
means,  i.e..  samples  1.  2.  and  3.  Even  in 
sample  4  (see  Table  1)  there  was  only  a 
difference  of  0  06  mg  Cl2  L  in  the  means. 
Once  detected,  this  difference  was  ex¬ 
amined  to  determine  whether  it  was 
acceptable.  In  most  water  treatment 
plants,  a  difference  of  0.06  mg  Cl .  L  will 
not  be  significant,  and  therefore  the 
difference  is  acceptable. 

A  comparison  of  the  results  obtained 
with  the  potentiometric  electrode  and 
those  obtained  with  the  total  chlorine 
analyzer  showed  no  statistically  signif¬ 
icant  differences  at  the  95  percent  level  of 
confidence  in  samples  l.  2,  and  3  (Table 
2).  Sample  4  appeared  to  be  statistically 
different  with  x  =  1.21  for  the  potentio¬ 
metric  electrode  and  x  =  1.35  for  the  total 
chlorine  analyzer. 

Precision  of  individual  analysts.  Each 
sample  was  divided  into  four  subsamples. 
Each  analyst  received  a  subsample  for 
use  in  testing  each  procedure.  Triplicate 
analyses  were  performed,  and  the  preci¬ 
sion  of  an  individual  analyst  was  deter¬ 
mined  by  using  the  relative  standard 
deviation  (the  standard  deviation  was 
divided  by  the  mean  and  then  multiplied 
by  100)  The  data  are  summarized  in 
Table  3. 

It  appears  from  the  data  that  an 
individual  analyst's  precision  with  the 
potentiometric  electrode  was  best  when 
measuring  low  chlorine  levels  (<1.0  mg 
Cl2-  L).  In  compering  t  he  means  of  samples 
1  and  2  obtained  by  each  analyst,  it 
appears  that  in  both  cases,  analyst  4 
obtained  low  results  If  the  results  ob¬ 
tained  for  samples  1  and  ..  by  analyst  4 
were  eliminated,  then  the  overall  precision 
of  the*  procedure  would  be  increased.  The 
overall  means  of  samples  1  and  2  were 


very  similar  to  those  obtained  by  the 
referee  method  (Table  l|. 

Over  the  entire  range  of  chlorine  con¬ 
centrations  tested,  no  differences  in  pre¬ 
cision  were  evident  from  the  results  ob¬ 
tained  with  the  total  chlorine  analyzer 
These  results  appeared  to  be  independent 
of  the  analyst  who  performed  the  proce¬ 
dure. 

Tap  water  samples.  Precision  of  all  an¬ 
alysts  Four  samples  of  tap  water  were 
used.  Each  analyst  obtained  triplicate 
results  for  each  of  the  four  procedures 
Because  the  tap  water  contained  bol  h  free 
and  combined  chlorine,  different  compar¬ 
isons  were  obtained  The  comparisons  of 
the  free  chlorine  reading  obtained  by 
using  the  amperometric  titrator  with 
those  from  the  two  membrane  electrodes 
are  shown  in  Table  4. 

The  results  indicate  good  agreement 
between  the  means  of  the  values  obtained 
from  the  two  membrane  electrodes,  no 
statistical  difference  was  detected  at  the 
95  percent  level  of  confidence  except  for 
sample  5  (Table  5).  In  every  case,  the 
relative  precision  was  better  with  mem¬ 
brane  electcode  A  than  with  membrane 
electrode  B.  This  may  be  related  to  the 
small  size  of  meter  B  on  which  readings 
were  taken,  resulting  in  less  accurate 
interpolation  between  numbers.  Surpris¬ 
ingly.  these  results  obtained  from  the 
membrane  electrodes  are  low  compared 
with  those  obtained  from  the  amperomet¬ 
ric  titrator.  This  point  will  be  discussed 
further  under  the  discussion  of  active 
chlorine  speciation 

Table  6  summarizes  the  data  for  the 
measurements  of  total  chlorine  in  the  tap 
water  samples.  When  the  results  from  the 
amperometric  titrator  were  compared 
with  those  from  the  potentiometric  elec¬ 
trode.  there  was  no  statistical  difference 
for  sample  6  at  the  95  percent  level  of 
confidence  (Table  7).  In  every  sample, 
except  sample  7.  the  relative  precision 
was  less  with  the  amperometric  titrator 
than  that  with  the  electrode.  Again,  it 
should  be  pointed  out  that  only  one 
analyst  used  the  amperometric  titrator. 
whereas  four  analysts  used  the  potentio¬ 
metric  electrode. 

A  statistical  difference  at  the95  percent 
level  of  confidence  was  obtained  for  all 
samples  except  sample  8  when  measure¬ 
ments  from  the  amperometric  titrator 
were  compared  with  those  from  the  total 
chlorine  analyzer.  Statistically  different 
means  were  obtained  with  these  two 
methods.  This  was  also  the  case  with  the 
quality  assurance  samples.  The  spread 
was  somewhat  larger  between  the  means 
(except  for  sample  8|.  but  in  no  case  was 
the  difference  greater  than  the  0.08  mg 
Cl-  L.  which  was  observed  in  sample 
This  difference  represents  an  absolute 
difference  of  7.2  percent  from  the  mean 
concentration  determined  by  amperomet¬ 
ric  titration.  The  differences  in  samples  5 
and  6  were  4.5  percent  and  3  6  percent 
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TABLES 

Summary  of  th#  calculated  t-statistic. 
adjusted  degrws  of  fr««dom.  and  value  of  the 
95  percent  level  t-distribution  used  for 
comparison  of  data  from  Table  4 
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?r**dom  i*  not  significant  andtharaforo  no  calculation  wee 
net  attar? 


TABLE  6 

Descriptive  statistics  of  the  test  procedures  for  determining  the  total  ch/orine  content 
of  top  water  samples 
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TABLE  7 

Summary  of  the  calculated  t -statistic,  adi usted  degrees  of  freedom,  and  value  of  the  95  percent  level  t-distribution  used 

for  comparison  of  data  from  Table  6 
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TABLES 

Summary  of  single  analyst  statistics  and  relative  standard  deviation  for  test  procedures 
_ used  in  analyzing  the  free  available  chlorine  content  of  top  water  samples _ 
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respectively.  The  differences  were  min* 
imai  and  would  not  be  significant  to  the 
operation  of  a  water  treatment  plant. 

The  comparison  of  the  potentiometnc 
electrode  with  the  total  chlorine  analyzer 
indicated  a  statistical  difference  in  sam* 
pies  5  and  0  (at  the  95  percent  level  of 
confidence)  The  difference  in  the  means 
was 0.14  mg Clr  Lin  sample  5  and 0  09  mg 
Cl:  L  tn  samples.  No  statistical  difference 
was  observed  in  samples  6  and  7. 

Precision  of  individual  analysts  Each 
sample  was  divided  into  four  subsamples 
Each  analyst  received  a  subsample  for 
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use  in  testing  each  of  the  procedures.  The 
tap  water  contained  both  a  free  and  a 
combined  residual;  therefore,  the  data 
were  divided  into  free  chlorine  and  total 
chlorine  measurements.  The  precision  of 
individual  analysts  for  the  free  available 
chlorine  determinations  are  presented  in 
TableB.  An  individual  analyst's  precision 
obtained  with  either  membrane  electrode 
was  considerably  less  than  the  overall 
precision  (Table  4)  It  was  also  apparent 
from  a  comparison  of  thp  means  for  in> 
one  sample  that  considerable  variability 
existed  This  variability  accounted  for 


the  large,  overall  relative  standard  devia¬ 
tion. 

As  a  prototype  instrument,  membrane 
electrode  A  and  its  associated  electronics 
may  require  additional  engineering  to 
reduce  the  variability  in  results  from 
analyst  to  analyst.  Also,  the  electrical 
noise  detected  by  the  electronics  could 
have  caused  some  of  the  fluctuations  in 
measurements  Stirring  of  the  sample  is 
critical  w  hen  using  membrane  electrodes 
im  slight  variations  in  stirring  speed 
i the  velocity  nf  fluid  across  the  mem¬ 
brane)  can  cause  large  variations  in  the 
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TABLE  9 

Summery  of  single  analyst  statistic*  aM  relative  standard  deviation  fcr  ?«t  p raced  j 
used  in  ona.’yzint;  me  total  c*  ferine  of  tap  water  sampler 
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TABLE  10 

Summary  of  analyst  precision  tviih  test  procedures  for  analyzing  quolity  assurano  samples 
prepared  with  chlorine-demand  free  water 


Amp«ram*mc 

Titrator’ 


Pot*niio«3#trir 

Electrode 


Total  Chiorm 
Amin*' 


Atarag*  single  analv*'  prtemon  1  2  7  o 

Avnraga  overall  analyst  precision  |  2  3  |  12  0  j  0 

•Only  on*  analyst  used  the  amperometnc  turator  whirtii  four  analyst*  uaad  aach  of  the  other  procedure* 
’Relative  ttendard  deviation 


TABLE  11 

Summary  of  analyst  precision  with  test  procedures  for  analyzing  the  free  ovoiloble  chlorine 
of  tap  water  samples 


Amoerometrir  Membrane 
Ele<  rode  A 


Amperomeirn  MemDri 
f  lei  t"*de  B 


Average  tingle  anaivit  precision  19’  *6  ft  9 

Average  overall  analvti  precision  |  3  I  12  9  31  5 

*Oni\  one  analyst  used  the  amperomeirtc  tilrator  whereas  four  analysts  used  each  of  the  other  procedure* 
’Relative  standard  deviation 


TABLE  12 

Summary  of  analyst  precision  with  test  procedures  for  analyzing  the  total  chlorine  of  top 
water  samples 


Potent  i  ometrir 
Electrode 


Total  Chlorine 
Analyser 


Average  single  anaiy  si  precision  2  0’  2  4  0 

Average  overall  snalv si  precision  3  0  *8  1 

■Oniv  one  anaivst  used  the  amperomeirtc  turator  whereat  four  analyeis  used  each  of  the  other  procedures 
’Relative  standard  devianon 


measurements  Membrane  electrode  A 
was  calibrated  daily. 

Membrane  electrode  B  was  extremely 
stable  throughout  (he  evaluation.  The 
calibration,  as  adjusted  at  the  factory, 
was  checked  daily  but  did  not  require 
adjustment  over  a  two-month  period.  The 
single  largest  factor  that  may  account  for 
the  analyst-to-analyst  variation  was  the 
size  of  the  meter.  Because  the  meter  is 
small.  large  errors  in  interpolation  of 
numbers  on  the  meter  are  possible. 

Table  9  mmarizes  the  precision  of 
individual  analysts  in  measuring  the  total 
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chlorine  content  of  tap  water.  Very  little 
difference  was  observed  between  the 
precision  obtained  with  the  amperometnc 
titrator  and  that  obtained  with  the  po- 
tentiometric  electrode. 

For  the  total  chlorine  analyzer,  a  rela¬ 
tive  standard  deviation  of  0.5  percent 
was  calculated  for  the  average  precision 
of  individual  analysts.  This  result  was 
1.5  percent  less  than  (hat  for  the  ampero- 
metric  titrator.  Again,  as  was  observed 
from  the  analyses  of  the  quality  assurance 
samples,  the  results  obtained  with  the 
total  chlorine  analyzer  appear  almost 


independent  of  the  analyst  who  performed 
I  the  procedure. 

Summery  of  preefeton.  Summaries  of  (he 
!  average  precision  of  individual  analysts 
and  all  analysts  are  presented  in  Tables 
10.  11.  and  12  The  average  precision  of 
individual  analysts  was  always  better 
than  the  average  precision  of  all  analysts 
The  data  for  the  amperometnc  titrator 
were  obtained  by  one  analyst  and  were 
similar  for  quality  assurance  samples 
and  for  tap  water  samples 
The  average  precision  of  individual 
analysts  with  the  potentiometnc  electrode 
is  comparable  to  that  with  the  ampero- 
metnc  titrator.  However,  the  average 
precision  of  all  analysts  with  the  poten¬ 
tiometnc  electrode  was  not  as  good  as 
that  with  the  amperometnc  titrator  This 
difference  in  precision  may  have  been  due 
to  the  nondigital  millivolt  meter  that  was 
used.  (When  millivolts  are  read  on  an 
armature  meter,  the  third  place  must  be 
estimated,  and  this  can  lead  to  significant 
errors  1  Moreover,  the  standard  curve 
was  obtained  by  using  only  one  millivolt 
reading  for  each  concentration  Precision 
probably  would  have  been  better  if  dupli¬ 
cate  or  triplicate  millivolt  readings  had 
been  obtained  for  each  standard  and  then 
these  data  had  been  analyzed  by  linear 
regression. 

Both  membrane  electrodes  produced 
rather  large  estimates  of  the  average 
precision  of  all  analysts  The  reasons  for 
this  have  been  discussed 

The  total  chlorine  analyzer  consistent 
gave  excellent  precision  This  technique 
for  measuring  total  chlorine  appears  to  be 
independent  of  the  analyst  who  performed 
the  procedure 

Acthw  chlorine  speciation  in  natural 
systems 

The  amperometnc  titrations  were  very 
reproducible  for  analyzing  the  tap  water 
samples  For  the  membrane-covered  am- 
perometnc  electrodes,  values  were  ob¬ 
tained  that  averaged  approximately  21 
percent  of  the  values  obtained  from 
amperometnc  titration.  (The  one  excep 
tion  was  for  electrode  A  and  sample  5.  the 
electrode  determined  a  value  that  was  35 
percent  of  the  value  determined  by  am¬ 
perometnc  titration  )  Two  possible  ex¬ 
planations  for  these  low  values  are  either 
that  the  electrodes  were  not  functioning 
properly  or  that  there  could  have  been 
active  chlorine  species  in  the  water 
which  mimicked  free  chlorine  in  the 
amperometnc  procedure  but  did  not 
permeate  the  HOC)  specific  membrane 
It  is  possible  that  the  membrane  ele<  • 
trodes  were  not  functioning  properly  and 
there  was  a  chance  that  both  electrodes 
gave  similar  readings  The  fac(  that  less 
chlorine  was  detected  by  both  membranes 
indicates  that  very  little,  if  any  .  inorganic 
chloramine  (presuming  this  species  was 
present)  permeated  the  membrane  Gen¬ 
erally.  if  the  membrane  electrodes  wpre 

JOURNAL  awwa 


V  */  V  V  V  V  ’ 


m 


malfunctioning,  the  error  would  have 
been  positive  (i.e..  higher  value),  not 
negative,  with  respect  to  the  ampero met¬ 
ric  titrator. 

It  has  been  shown  by  several  analytical 
methods  that  organic  nitrogen  chlo¬ 
ramines  appear  as  free  chlorine.1*  The 
formation  of  these  compounds  has  been 
studied. Direct  evidence  for  the  pres¬ 
ence  of  organic  nitrogen  compounds  in 
southern  Florida  groundwater  has  been 
confirmed  by  the  formation  of  dihalo- 
acetonitnles.*1  No  routine  method  exists 
for  determining  organic  nitrogen  chlo¬ 
ramines.  Recently,  a  method  has  been 
published,  which  may  provide  the  neces¬ 
sary  derivational  procedure  for  determin¬ 
ing  organic  nitrogen  chloramines. u 

Thus,  there  is  no  definitive  explanation 
for  the  low  values  obtained  with  the 
membrane  amperometric  electrode.  How¬ 
ever.  one  cannot  rule  out  the  possibility 
that  the  amperometric  titrator  is  not 
specific  for  free  chlorine  and  that  organic 
nitrogen  chloramines  account  for  falsely 
high  levels  of  free  chlorine. 

Summary  of  tha  statistical  analyses 

1.  The  following  observations  were 
made  regarding  the  analysis  of  the  quality 
assurance  samples  (in  all  cases,  the  level 
of  significance  was  95  percent): 

•  There  was  no  statistical  difference 
between  results  obtained  with  the  am¬ 
perometric  titrator  and  those  obtained 
with  the  potentiometnc  electrode. 

•  For  ail  samples,  there  was  a  statistical 
difference  between  results  obtained  with 
the  amperometric  titrator  and  those  ob¬ 
tained  with  the  total  chlorine  analyzer 
The  largest  absolute  difference  in  the 
means  was  0.06  mg  Clj-L. 

•  There  was  no  statistical  difference 
between  the  results  obtained  with  the 
potentiometnc  electrode  and  those  ob¬ 
tained  with  the  total  chlorine  analyzer  for 
three  of  four  samples.  For  the  one  sample, 
the  mean  was  1.21  with  the  potentiometnc 
electrode  and  l  35  with  the  total  chlonne 
analyzer 

•  The  precision  of  all  analysts  was 
best  with  the  total  chlorine  analyzer, 
followed  by  the  amperometric  titrator 
and  then  the  potentiometnc  electrode. 

2  The  following  observations  were 
made  regarding  the  analysis  of  the  free 
chlorine  in  tap  water  samples  fin  all 
cases,  the  level  of  significance  was  95 
percent): 

•  The  results  obtained  with  the  mem¬ 
brane-covered  electrodes  were  not  signif¬ 
icantly  different  in  three  of  four  samples. 

•  Both  membrane-covered  electrodes 
detected  chlorine  levels  that  were  an 
average  of  21  percent  less  than  the  levels 
detected  with  the  amperometric  titrator. 

1  The  following  observations  were 
made  regarding  the  analysis  of  the  total 
'hlorine  in  tap  water  samples  [in  all 
cases  the  level  of  significance  was  95 
percent). 
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•  For  ail  samples,  the  results  obtained 
with  the  potentiometric  electrode  were 
lower  chan  those  obtained  with  the 
amperometric  titrator.  The  difference  was 
statistically  significant  in  three  of  four 
samples. 

•  The  results  obtained  with  the  total 
chlorine  analyzer  were  low  in  three  of 
four  samples,  with  no  statistical  differ¬ 
ence  in  the  fourth  sample.  The  greatest 
difference  between  means  was  0.08  mg 
Clj/L. 

•  For  two  of  four  samples,  the  results 
obtained  with  the  potentiometric  elec¬ 
trode  were  statistically  different  from 
those  obtained  with  the  total  chlorine 
analyzer. 

•  The  precision  of  all  analysts  was 
best  with  the  total  chlorine  analyzer, 
followed  by  the  amperometric  titrator 
and  then  the  potentiometric  electrode. 

4.  Of  all  the  methods  tested,  including 
the  amperometric  titrator.  the  total  chlo¬ 
rine  analyzer  produced  the  best  precision 
for  both  individual  analysts  and  for  all 
analysts. 

5  For  ail  of  the  electrode  procedures, 
precision  of  individual  analysts  was 
better  than  the  precision  of  all  analysts 
combined 

Conclusions 

The  total  chlorine  analyzer  was  shown 
to  be  analyst  independent,  providing 
online,  continuous  measurement  This 
instrument  would  be  the  method  of  choice 
when  continuous  or  many  total  chlorine 
analyses  are  required.  Although  operation 
of  the  potentiometnc  electrode  is  easy, 
the  results  can  vary  from  analyst  to 
analyst  and  would  require  additional 
quality  assurance  for  in-plant.  multi- 
analyst  operation.  No  conclusion  can  be 
made  regarding  the  amperometrn  mem¬ 
brane  electrodes  because  of  the  variability 
m  the  results. 
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Appendix 

Calculation  of  the  r- statistic.  The  [-statistic 
is  used  to  test  the  hypothesis  that  two 
sample  means  are  the  same  In  calculating 
the  t-statistic.  it  is  assumed  that  the  data 
are  normally  distributed  about  the  mean. 
The  general  formula  for  determining  the 
t-statistic  is  given  in  Eq  2 

For  example,  to  compare  the  results 
obtained  from  the  amperometric  titrator 
I <i |  with  those  obtained  from  the  pnten- 


Uometric  electrode  (p).  data  for  sample  1 
from  Table  1  are  substituted  into  Eq  2 
Therefore.  x0  -  0  40.  ^  =  0.000169.  n(J  =  12. 
Xp  =  0.3B,  s^  =  0.00360.  and  np=  12.  then 

0  40  -  0.38 

/  ‘1000169  .  0  00360 

J  12  12 

=  0.02 
0  0177 
-  1  129 

In  another  example,  data  for  sample  3 
from  Table  1  are  substituted  into  Eq  2  to 
compare  the  results  obtained  from  the 
amperometric  titrator  (a)  with  those 
obtained  from  the  lotal  chlorine  analyzer 
|cj.  For  x0  =  l.26.  5^  =  0.000529.  na  =  12. 
x,  =  1.30.  si  =0.000169  and  nr  =  12.  then 

\.26  -  *  .30 

t  - -  - 

/  0  000529  0  000169 

J  12  12 

=  -0  04 

nuo-r.3 


When  calculating  the  t-statistic.  the  sign 
is  disregarded  and  a  positive  value  is 
reported  ( r =5.24 1  because  differences  in 
either  direction  are  being  investigated 
Calculating  tha  adjusted  dagraas  of  freedom 
by  using  tha  Sattarttiwaita  approximation.  The 
ADF  must  be  used  when  the  means  of  two 
samples  are  to  be  compared  by  using  the 
t-statistic.  but  the  two  samples  have 
different  variances  The  general  formula 
for  determining  the  ADF  is  that  given  in 
Eq  3 

For  example,  to  ■  ompare  the  results 
obtained  from  the  amperometric  titrator 
tol  with  those  obtained  from  the  poten¬ 
tiometric  electrode  |p).  one  must  know 
the  ADF  Therefore,  data  for  sample  1 
from  Table  1  are  substituted  into  Eq  3 
For  =0  000169.  n(J=  12.  v.  =  0  00360. 
and  =  12.  then 

--  000)69  -  o. 003601- 

*12  12  ' 


0  0001691*  /  0  00360 \ 


it  : : 

_ 9  86  •  !Q-‘ _ 

1  803  •  JO  1  -  8  2  ■  tO - 

-4/3 

'2  i rounded  io  nearest 
;n>wl 

In  the  sample  calculations  tor  .V  ADF 
that  follow  the  data  are  for  sample  2  from 
Table  1.  for  sample  1  from  Table  1  and 
for  sample  6  from  Table  4  respectively 
In  these  <  alrulat ions,  a  refers  to  the 

a- .  recPEP  e~  al 
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Finally  -  0  000256  nc-12.sj  = 

0.000144  and  :i,  -  12.  then 

„  11  x  10-* 

ADF  - 

4.14  «  10-  -  1.3  «  10 

*  20  4 

•  20 

These  -alculations  for  ADF  clearly 
‘•monstrate  that  as  the  variances  (s-j  of 
two  samples  approach  the  same  value, 
the  degrees  of  freedom  approach  the 
limiting  value.  Consider  the  case  in  which 
two  samples  h<-  e  equal  variance,  and 
n  =  12  for  each  sample  In  this  case,  the 
maximum  number  of  degrees  of  freedom 
is22.i.e.  n.-l|~|n;-l|  Forthesample 
calculation  given  above  in  which  the  two 
variances  wereO  000169  and  0.00360  and 
n=  12  for  both  samples  then  the  ADF 
was  calculated  to  be  12  However,  for  the 
last  sample  calculation  given  above,  in 
which  the  two  variances  were  0  000256 
and  0.000144.  the  ADF  was  calculated  to 
be  20 

Calculation  ot  the  level  of  significance  for 
compering  sample  means.  The  researcher 
chooses  the  significance  level  :  probability 
level!  In  be  used  For  a  95  percent 
significance  level  a  =  0  05.  for  a  99 
percent  significance  level  a  =0  01 

In  order  to  use  a  t-statistic  to  compare 
sample  means  one  must  make  adiusi- 
ments  for  multiple  comparison  The 

Bonfermm  pr . Jure  ».«»n  a*  used  »n  make 

adiustments  foreach  pairwise  comparison 
b\  dividing  the  n  vai..e  bv  the  total 
number  of  comparisons  For  example  if 
there  are  three  means— A  B  and  ('.'—and 
one  wishes  to  compare  A  to  B  and  A  to  C. 
the  a  lev  el  is  divided  bv  2  However,  if  one 
wishes  to  compare  A  to  B.  A  to  C.  and  B  to 
C.  the  o  level  is  divided  bv  3.:* 

In  the  discussion  that  follows,  results 
obtained  from  the  amperometric  titrator 
are  compared  with  those  obtained  from 
the  total  chlorine  analyzer  The  data  are 
for  sample  2  from  Table  2 

For  i  -  3  074  and  ADF  =  12.  the  95 
percent  confidence  level  la  =  0.05 1  is 
obtained  by  evaluating  the  two-tailed  t  at 
a  =  0  05  1  =  0.017  From  such  an  evalua¬ 


tion  it  can  be  determined  that  t  =  2  78  for 
ADF  -  12  and  a  =  0.017  Sec « use  the 
calculated  value  of  f  =  3.074  is  greater 
than  2.78.  ih*  two  sample  means  ar. 
statistical! >  diiterent  at  the  95  percent 
confidence  level 

If  the  data  are  reevaluated  at  the  99 
percent  confidence  level  (a  =  0.01).  then  t 
=  3.65  for  ADF  =  12  and  a  -0  01  3=0.003 
Because  the  calculated  v  alue  of :  3  0“4]  is 
less  than  3.65.  the  two  sample  means  are 
not  statistically  different  at  the 99  percent 
confidence  level 
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i  A  statistical  experimental  design 
for  comparison  testing  of  j 

analytical  procedures 


Paul  H  Gibbs.  William  J.  Cooper,  and  Edward  M  Ott 


/UAll 


An  •xporimont  Kim  been  designed  for  comparison  (equivalency)  testing  of  an  approved 
standard  test  method  and  an  aHemattve  test  method.  The  design  has  been  applied  in 
tests  under  actual  operating  conditions  at  water  treatment  plants.  Statistical  analysis  of 
an  example  data  set  is  detailed.  The  estimates  of  single-analyst  precision  obtained  with 
this  design  may  reflect  the  results  sncountered  at  any  water  treatment  plant. 


The  US  Environmental  Protection 
Agency  IUSEPA)  promulgated  guidelines 
to  standardize  test  procedures  for  compli¬ 
ance  monitoring  These  guidelines  have 
been  amended  to  allow  applications  for 
approval  of  alternative  procedures  for 
nationwide  use  ;  As  part  of  the  appli¬ 
cation.  comparability  data  are  required 
between  the  proposed  alternative  proce¬ 
dure  and  an  approved  procedure.  The 
comparability  data  are  intended  to  test 
the  equivalency  of  the  two  methods.  The 
minimum  requirements  for  equivalency- 
testing  have  been  outlined  elsewhere.5 

This  article  describes  a  ge  ”alized 
experimental  design  that  can  b«  d  for 
obtaining  the  data  necessary  for  c  or¬ 
ison  testing,  a  particular  application  of 
which  is  equivalency  testing  Another 
article  details  results  of  this  experimental 
design  as  it  was  applied  to  free  available 
chlorine  test  procedures/ 

The  data  required  for  equivalency  test¬ 
ing  aiso  provide  estimates  of  single-ana- 
lvst  precision  for  the  analytical  methods 
tested  These  estimates  can  be  used  for 
purposes  other  than  equivalency  testing 
and  may  provide  valuable  data  for  eval¬ 
uating  the  relative  merit  of  analytical 
procedures  The  maior difference  between 
the  estimates  obtained  by  using  equiv¬ 
alency  testing  and  those  obtained  by 
analytical  chemists  who  develop  the 
methods  is  that  the  former  are  obtained 
under  actual  operating  conditions  at  water 
treatment  plants  These  single-analyst 
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estimates  of  precision  therefore  reflect 
results  that  would  be  obtained  at  other 
water  treatment  plants 

The  experimental  design  is  based  on 
several  general  criteria 

•  The  test  should  be  conducted  over  a 
time  span  that  covers  a  significant  change 
in  either  the  process  or  sample  quality 

•  Replicate  analyses  should  be  required 
on  samples  for  the  approved  and  proposed 
alternative  test  procedures  at  multiple 
laboratories 

•  The  test  program  should  require  a 
minimum  of  analyst  time  at  the  cooperat¬ 
ing  laboratory.  i  e  .  the  testing  program 
should  be  self-explanatory,  and  forms 
should  be  provided  for  data  collection 

•  Data  should  be  received  in  a  form 
that  facilitates  computer-aided  statistical 
evaluation 

•  Randomization  should  be  used  to 
assign  experimental  factors  to  the  samples 
and  to  determine  the  order  of  testing  of 
the  procedures  for  each  sample 

Experimental  design 

Experimental  lectori  (vertataee).  Several 
experimental  factors  were  identified  and 
included  in  the  experimental  design 

Methods  An  alternative  test  is  used  in 
addition  to  the  approved  method  currently 
in  use  at  the  test  location.  The  approved 
(standard)  method  is  denoted  by  SM.  and 
the  alternative  method  is  denoted  by  AM 

Locations  and  sites  The  expenmen*  is 
conducted  at  several  geograpn.caffy  *Jis 


persed  locations  (water treatment  plants) 
Water  quality  data  may  be  collected  at 
more  than  one  site  in  a  plant  (after  dif¬ 
ferent  water  reatment  processes!  thus 
the  design  allows  for  testing  at  two  sites 
within  any  one  plant  The  exact  position 
of  the  two  sites  within  the  water  treatment 
plant  is  determined  for  each  plant  and 
reported  on  the  forms:  i.e..  for  the  duration 
of  the  experiment,  one  position  :s  desig¬ 
nated  as  site  1  and  the  other  position  is 
designated  as  site  Z. 

Anoivsts  To  include  variability  result¬ 
ing  from  analyst  effects  in  the  chemical 
analysis,  two  analysts  who  normally  take 
the  readings  are  usually  available  for  the 
duration  of  the  experiment  at  each  loca¬ 
tion  The  two  analysts  work  on  the  exper¬ 
iment  independently  of  one  another  If 
only  one  analyst  is  available,  the  same 
total  number  of  observ  at  ions  (the  number 
taken  bv  two  analysts)  is  taken. 

Samples  The  duration  of  the  experi¬ 
ment  ilong  enough  to  include  variability 
in  plant  operation!  calls  for  sampling 
over  a  period  of  several  weeks  Samples 
are  obtained  in  the  same  manner  as  those 
collected  for  monitoring  normal  plant 
operations  Most  samples  require  one 
reading  with  the  approved  test  procedure 
and  one  reading  with  the  alternative  test 
procedure 

Ord pr  of  testing  T o  guard  against  bias 
in  the  results,  the  sequence  in  which 
results  are  obtained  for  anv  given  t  *st  is 
randomized  and  followed  carefully  bv 
each  analyst  It  is  necessary  to  emphasize 
that  pnor  experimental  test  results  should 
not  influence  the  analyst's  subsequent 
readings  because  this  will  invalidate  the 
experiment  To  help  guard  against  ’h* 
influent.*:  of  pr*\  :ous  rcsu.ts.  she  .nsiru* 
lions  to  the  analysts  expfu  »?h  poini  out 
•hr*  prten’ial 
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TABLE  1 

Experimental  design  for  equivalency  testing  at  one  water  plant 


Sampl* 

Numbif 

Day 

Analyat 

Sita 

R*ndom< ted  T**<  Sequent* 

I 

2 

2 

SM  AM 

2 

1 

SM  AM 

3 

i 

SM  AM 

z 

SM  AM 

5 

AM  SM 

0 

» 

SM  AM 

4 

AM  SM 

0 

AM  SM 

9 

SM  AM  AM  SM  AM  SM  AM  SM 

10 

V 

SM  AM  SM  AM  AM  AM  SM  SM 

M 

SM  AM 

12 

z 

SM  AM  SM  AM  AM  SM  SM  AM 

IJ 

2 

SM  AM  SM  AM  SM  AM  SM  AM 

t« 

t 

AM  SM  SM  SM  AM  AM  SM  AM 

15 

SM  AM 

10 

SM  AM 

1  7 

9 

2  1 

SM  AM 

111 

9 

1  1  1 

SM  AM 

'.9 

10 

AM  AM 

:o 

10 

2  2 

AM  SM 

n 

1  !  I 

AM  SM  AM  SM  AM  SM  SM  AM 

22 

n 

1  2 

SM  AM 

21 

12 

I  2 

SM  AM 

24 

;* 

I  J 

A  M  SM 

25 

:J 

:  '  l 

SM  AM 

20 

IJ 

1  i  2 

AM  SM 

•4 

2  •  1 

AM  SM 

20 

: « 

2  i  I 

AM  SM  SM  AM  SM  AM  AM  SM 

.’9 

n 

2  •  I 

AM  SM 

>0 

15 

2  ‘  1 

•sM  AM  AM  SM  AM  SM  AM  SM 

Jl 

•0 

1  2 

AM  SM  AM  SM  SM  AM  AM  SM 

12 

•0 

I  |  I 

AM  SM 

1] 

1  i  1 

AM  SM  AM  SM  AM  SM  SM  AM 

1* 

:  i 

AM  SM 

IV 

14 

!  i 

AM  SM 

10 

:0 

2  i  I 

SM  AM 

r 

•9 

:  j 

AM  SM  SM  AM  SM  AM  SM  AM 

10 

'9 

2  1  2 

AM  SM 

19 

20 

2  2 

SM  AM 

«0 

20 

2  2 

AM  SM 

It 

2 ! 

1  2 

SV1  AM 

*: 

» i 

2 

AM  SM 

u 

22 

2  2 

SM  AM 

44 

22 

->M  AM 

4? 

-J 

2  t 

SM  AM 

40 

.3 

2 

SM  AM 

4* 
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TABLE  2 

Sample  data  forms  provided  to  water  treatment  plants 


Sarnpl*  No  i 

Plant  10 
Analyst  2 
SittZ: 


Mon  Day 


Reading* 

Mfthod* 


Oala  Sara 

sample  No  9  Dale  -  - 

Mon  Da\  v- 

Plan*  ID  T  me  _  \M  PM 

Anal>»i  1  Dav  s  Mnrnmg 

Sila  t: 


i  irder 


Reartmga 

Me»hnd$ 


Subsamplma  To  meet  the  minimum 
requirements  of  the  experimental  design, 
multiple  analyses  are  made  on  a  pre¬ 
selected,  restricted  random  selection  of 
samples  The  selection  of  samples  is 
balanced  with  respect  to  analyst  and  site 
combinations  so  that  each  combination  of 
analyst  and  site  is  represented  equally 
The  multiple  analyses  of  each  sample 
also  have  a  preselected  random  sequence, 
such  as  AM  SM  SM  AM  AM  SM  AM 
SM  In  these  cases,  again,  the  analyst 
exercises  care  to  guard  against  biasing 
’he  results  of  subsequent  determinations 
by  preceding  observations  in  the  sequence 
These  additional  sample  analyses  are 
used  to  estimate  single-anal vst  precision 
Duration  The  experiment  requires  30 
working  davs  »n  <•  nmole'*  This  length  of 
*,\me  -*sulfs  m  minimum  daily  sampling 
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and  encompasses  a  time  span  sufficient 
to  observe  variability  in  plant  operation. 

Design  The  30  davs  allotted  for  the 
experiment  are  sequential  but  not  neces¬ 
sarily  consecutive;  i.e  .  dav  5  precedes 
day  6.  but  day  5  is  not  necessarily  adjacent 
to  dav  6  Each  day  is  split  into  a  morning 
and  an  afternoon  test  session,  although 
no  attempt  is  made  to  balance  the  design 
for  day  effect  Each  segment  of  the  day  is 
treated  as  a  separate  samole  The  design 
assumes  that  two  analysts  and  ‘wu  sues 
ire  K  iiidL'fe. 

If  om  v  one  site  is  av  .uinhle  ail  ’es»s  are 
performed  at  that  site,  including  ’hose 
designated  site  3  ”  Having  two  analysts 
and  two  sites  available  at  each  plant 
broadens  the  scope  of  the  experiment  but 
is  not  necessarily  applicable  to  ail  water 
quality  tests  The  specific  analyst  and 


site  combination  for  each  test  sample  is 
determined  by  a  random  process  so  that 
15  samples  are  allocated  to  each  combina¬ 
tion  of  analvst  and  site  tor  a  total  of  60 
samples.  Subsamples  for  multiple  deter¬ 
minations  are  chosen  bv  random  selection 
from  the  samples  allocated  to  each  analv  st 
and  site  combination,  in  this  case  'hree 
samples  from  each  combmauon  of  analv  st 
and  site  were  used.  The  sequence  m 
which  methods  are  tested  w  :'h  each  sam¬ 
ple  is  also  random  A  completely  different 
randomization  is  performed  for  each 
water  plant  regardless  of  the  numher  of 
plants! 

Computer  program  A  coirq.u'*-'  pr<  wr  im 
was  written  to  provide  ’he  nei*'*-*rv 
randomizations  to  conform  to  the  ualanced 
experimental  design  required  *<>r  sta'  s 
I  tea  l  analv  sis  The  output  at  'hi*  pr^g:  <m 
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for  one  treatment  plant  n  summarized  in 
Table  1 

To  read  Table  1.  consider  the  first  line 
as  an  example  On  day  1.  analyst  2  is  to 
obtain  a  reading  at  site  2  with  the  ap¬ 
proved  standard  test  method  followed  by 
a  reading  with  the  alternative  test  method 
The  first  sample  of  e*-ch  day  is  obtained 
in  the  morning:  the  second  is  collected  in 
theaftern  i  example  of  a  sample  on 
which  nv  lyses  are  required  is 

sample-  -?r  9.  On  day  .V  analyst  l  is  to 
obtain  .ipie  at  site  1  and  make  four 
analyses  using  the  approved  standard 
test  method  and  four  analyses  using  the 
alternative  method  in  the  followi  » order: 
SM  AM  AM  SM  AM  SM  AM  S 
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The  computer  program  provides  printed 
data  forms  corresponding  to  each  design 
For  every  location,  a  total  of  60  data 
forms  are  printed  out  Sample  data  forms 
are  shown  m  Table  2 

Thus,  a  complete  layout  of  the  experi¬ 
mental  design  with  data  collection  forms 
is  provided  to  each  participating  treat 
ment  plant  to  assist  personnel  in  planning, 
scheduling,  and  recording  results 

Statistical  analysis 

Dvflnitfon  o<  terms.  1  S»ng/e-onolvst  prp 
cision  A  measure  of  the  variability 
between  -  peated  measurements  made 
bv  ~  *je  analyst  on  the  same  sample 
■»mg  the  same  method  under  uniform 


conditions  usually  expressed  as  a  stan¬ 
dard  deviation 

2  Experimental  error  A  measure  of 
variability  in  the  data  not  accounted  for 
by  experimental  factors  and  composed  in 
part  of  single-analyst  precision,  usually 
expressed  as  a  variance 

3  A  VOVA  Analysis  of  variance,  a 
statistical  technique  for  attributing  vari¬ 
ability  in  data  to  certain  experimental 
factors  and  for  assessing  the  significance 
of  the  factors  in  accounting  for  the  total 
variability 

4  Sum  of  squares  A  mathematical 
quantity  that  expresses  the  amount  of  the 
tr**a!  vanabilifi  in  the  observations  at- 
•nhufed  'o  each  experimental  factor 
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5.  Degrees  of  freedom:  Number  of  cases 
used  to  estimate  a  mean  square,  decreased 
by  the  number  of  mathematical  con¬ 
straints  on  the  statistic.  Usually  'he 
number  of  constraints  is  one 

6.  Mean  square  The  sum  of  squares 
divided  by  the  degrees  of  freedom 

7.  F-test.  A  statistical  test  for  deter¬ 
mining  whether  an  experimental  factor 
significantly  explains  the  variability  in 
the  data.  It  is  calculated  by  dividing  the 
mean  square  by  the  appropriate  error 
term  for  each  experimental  factor  being 
tested. 

8.  Error  mean  square.  An  estimate  of 
the  experimental  error  variance  deter¬ 
mined  from  the  data  by  an  ANOVA. 

9  Power  The  probability  of  rejecting 
the  hypothesis  of  equality  of  means,  or 
the  sensin'.  :ti  of  the  statistical  test 
Power  depends,  m  part,  on  the  magnitude 
of  the  experimental  error  relative  to  the 
true  difference  in  means  and  on  the  sample 
size  (see  the  section  on  power  under 
"Interpretation  of  Results"! 

10  Significance  level  The  preassigned 
probability  of  concluding  that  the  methods 
are  not  equivalent  when,  in  fact,  the 
methods  are  equivalent 

11  Main  *»fferf  Refers  to  the  effects  on 
the  measured  response  of  one  of  the 
experimental  variables 

12  Interaction  A  measure  of  the  de¬ 
pendence  of  one  main  effect  on  one  or 
more  other  main  effects 

13  IVithin-sampie  vanofion  A  mea¬ 
sure  of  the  variation  of  observations  made 
on  fhp  same  sample 

14  Berw  •'en- sample  variation  A  mea¬ 
sure  of  the  variation  between  observa¬ 
tions  on  different  samples 

15  Coefficient  of  v  oriafion  The  stan¬ 
dard  deviation  divided  by  the  mean  and 
expressed  as  a  percentage 

16  re-*;  A  statistical  test  used  to 
compare  the  variances  or  two  or  more 
samples 

Slngto- analyst  precision.  Using  only  those 
12  samples  with  multiple  determinations 
of  i»ight  readings  ifour  by  each  method), 
single-analyst  precisions  are  estimated 
for  each  method  and  compared  by  statis¬ 
tical  tests  Th**  estimates  are  derived 
within  each  location  and  represent  the 
variation  between  repeated  observations 
averaged  ov  er  both  analysts  in  each  loca- 
Mon  Table  31 

Single-analyst  precision  is  estimated 
from  the  within-sample  variation  of  re¬ 
peated  determinations  on  a  randomly 
selected  subset  of  samples  made  over  the 
span  of  the  experiment  For  each  location. 
48  observations  per  method  are  available 
for  analysis  (4  *  121  The  subsample 
selected  is  balanced  with  respect  to 
combinations  of  analvst  and  site  to  avoid 
biasing  the  estimates  of  precision 

If  the  means  of  the  methods  vary  signif¬ 
icant  it  would  be  advisable  to  use 
coefficients  of  variation  to  estimate  and 
compare  precisions  of  the  methods  be¬ 


cause  precision  is  often  correlated  with 
the  mean  Otherwise  the  single-analyst 
precisions  may  be  compared  by  using  the 

Comparison  letting.  The  ANOVA  analy¬ 
sis  (Table  4)  is  performed  for  each  loca¬ 
tion.  The  additional  observations  for  those 
samples  with  multiple  determinations  are 
discarded,  and  onlv  the  first  paired 
determinations  are  used  Therefore,  for 
60  samples  and  two  determinations.  120 
observations  are  analyzed 

There  are  two  error  terms:  samples 
(analyst  *  site),  which  is  the  error  term 
for  bet ween-sample  comparisons,  such 
as  analyst,  site,  and  analyst  *  site,  and 
the  experimental  error,  which  serves  as 
the  error  term  for  all  method  effects 
including  interactions.  The  experimental 
factors  are  then  tested  using  F-tests. 
against  their  appropriate  error  terms.1 

The  analysis  is  comparable  to  a  paired 
t-test  on  methods  in  that  between-sample 
variation  is  removed  from  the  analysis 
before  the  method  effect  from  within* 
sample  variation  is  estimated  The  inter¬ 
actions  of  method  with  analyst  and  with 
site  provide  tests  of  whether  the  method 
effect  is  analyst-dependent  or  site-de¬ 
pendent  Evidence  of  either  dependency 
calls  for  investigation  of  the  underlying 
causes  The  three-way  interaction  of 
method  with  analyst  and  site  is  usually 
difficult  tointerpret  If  present  this  source 
of  variation  sometimes  indicates  depen¬ 
dence  of  the  method  effect  on  the  com¬ 
bination  of  site  and  analyst  Under  this 
circumstance,  jf  js  impossible  to  draw 
valid  conclusions  about  the  method  effect 
from  the  data  Underlying  causes  should 
again  be  examined  The  relative  magni¬ 
tude  of  the  interactions  should  be  exam¬ 
ined  by  using  tables  of  means  and  stan¬ 
dard  errors  Competent  statistical  advice 
should  be  sought  m  the  interpretations  of 
interactions  because  the  ANOVA  may  be 
overly  sensitive  to  minor  differences  in 
the  data,  which  could  lead  to  ovennter- 
pretation  of  the  results 

An  overall  assessment  of  equivalency 
of  methods  can  be  obtained  by  a  simple 
paired  t-tesf  on  the  method  means  for 
each  plant  This  test  assumes  that  the 
method  precisions  do  not  change  between 
locations  If  this  is  not  the  case,  an  overall 
test  of  equivalency  may  not  be  possible, 
and  only  tests  for  equivalency  within 
each  location  may  be  done 

Interpretation  of  results 

Results  of  the  ANOVA  should  be  treat¬ 
ed  cautiously  because  results  of  hypothe¬ 
sis  testing  are  largely  dependent  on  the 
sample  sizes  and  experimental  errors 
Overly  sensitive  statistical  tests  may 
detect  differences  that  are  not  meaningful 
from  an  operational  point  of  view.  Also, 
insensitive  statistical  tests  may  not  detect 
differences  *haf  are  operationally  mean¬ 
ingful  The  definition  of  operationally 
toeaningf  ui  differences  must  oe  agreed  on 


prior  to  the  experiment,  not  after  the  data 
have  been  collected,  to  avoid  the  intro¬ 
duction  of  biased  definitions 

If  possible,  the  power  of  the  tests  should 
be  examined  to  determine  the  sensitivity 
of  the  ANOVA  |see  the  following  section 
on  power)  If  the  statistfcal  tests  are  not 
sensitive  enough,  the  minimum  detectable 
difference  will  be  larger  than  is  operation¬ 
ally  acceptable,  and  the  tests  will  not 
detect  differences  of  operational  impor¬ 
tance.  Increasing  sample  sizes  may  alle¬ 
viate  this  problem  unless  the  methods 
have  inherently  large  precisions  On  the 
other  hand,  if  the  minimum  detectable 
difference  is  too  small  to  be  operationally 
meaningful,  the  statistical  tests  may  sig¬ 
nal  rejection  of  equivalency  on  the  basis 
of  small  differences  in  means  In  this 
latter  case,  one  can  revise  the  hypothesis 
being  tested  to  include  an  "acceptable 
window  of  difference  in  the  method  means 
and  test  for  departures  from  this  w  indow 
Also,  and  this  is  true  in  all  cases  the 
confidence  intervals  on  the  mean  differ 
ences  can  be  examined  to  assess  the 
magnitude  of  the  differences  detected  bv 
the  ANOVA  This  latter  step  is  somew  hat 
subiective  unless  a  prior  understanding 
has  been  reached  before  the  experiment  is 
run  as  to  the  magnitude  of  the  acceptable 
difference  between  methods 

Pow*r  As  defined  prev  lousiv .  power  is 
a  measure  of  thesensitmtv  of  a  statistical 
test  of  a  hypothesis  It  can  be  expressed  in 
several  ways  but  the  most  convenient  is 
the  minimum  detectable  difference  This 
is  the  minimum  true  difference  in  method 
means  that  can  be  detected  statistically 
with  a  given  probability .  at  a  given  signif¬ 
icance  level,  for  a  given  number  of  sam¬ 
ples.  and  for  a  given  estimate  of  experi¬ 
mental  error  In  one  case  power  is  set  at 
0.80  and  the  significance  level  is  set  at 
0.05 

Let  ±  be  the  minimum  positive  detect¬ 
able  true  difference  If  n  paired  samples 
are  available  and  S'  is  the  estimated 
experimental  error  from  the  ANOVA  for 
equivalency  Ibased  on  at  least  30  degrees 
of  freedom)  then  A  can  be  estimated 
approximately  by 

J  -  2. B0  x  2S~  r. 

Example  calculations  of  A.  for  n  =  30  and 
for  various  estimates  of  S-.  are  shown  in 
Table  5  Thus,  for  a  significance  level  of 
0.05  and  30  paired  samples  with  an  esti¬ 
mated  experimental  error  of  0.008  there 
is  an  80  percent  chance  of  detecting  a  true 
difference  in  method  means  of  at  least 
0.06  or  greater  by  using  statistical  tests 

Example  data  set  and  statistical 
analysis 

To  illustrate  the  procedure  that  is  used 
in  analyzing  the  data,  an  exampledata  set 
is  analyzed  in  this  section  Table  6  is  the 
result  of  the  design  shown  in  Table  J 
Codes  for  SM  and  AM  are  1  and  3. 
respectively  In  this  example  the  tv**- 
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chlorination  ■>:'**  ‘.s  site  1.  and  the  post- 
chiorination  site  is  site  2.  Most  of  the 
results  can  be  obtained  by  using  any 
convenient  statistical  package  available 
from  computer  services 

Sing»*-ana4y«t  precision.  The  12  samples 
with  multiple  determinations  are  selected, 
and  the  estimates  of  precision  are  calcu¬ 
lated  for  each  method  by  using  a  one-way 
ANOVA.  The  data,  which  are  multiplied 
by  10  to  increase  resolution,  are  presented 
in  Table  7. 

Because  the  data  are  multiplied  by  10. 
the  variances  are  multiplied  by  100.  Thus, 
the  variance  estimates  must  be  divided 
by  100  to  obtain  'tie  original  scale 

=  0  00625 
*  0  00526 

The  precisions  are  then  the  square  roots 
of  the  variances 

?Vvt  "  0  tTM  mg  L 
wv.»  "  0  ?**’*  rnt 

To  test  for  equality  the  ratio  of  the 
largest  variance  to  the  smallest  is  com¬ 
puted  b\  using  the  Fm<i„  test 

F.„.  =  0  00625  0  00528  -  t  18 

This  value  is  referred  to  the  appropriate 
Fmat  statistical  tablp  and  declared  not  to 
be  significant  at  the  99  percent  level  of 
confidence 

The  relative  precisions  may  also  be 
calculated  bv  computing  the  single-ana* 
ivst  precisions  as  percents  of  the  means 
Table  fti  for  prechlorination  isite  l|  and 
pos»chlonnation  (site  2| 

In  this  particular  case,  the  pr»r  h:  rina- 
tion  means  are  much  lower  tnar  'he 
postchlnrinatioD  ."leans.  resulting  ic  dif¬ 
ferent  pattern*  of  re!  *five  precision 


Nevertheless,  the  methods  are  comparable 
within  each  site 

Equivalency  tasting.  The  results  of  the 
ANOVA  used  for  comparison  (equiva¬ 
lency)  testing  are  shown  in  Table  9. 

The  analyst,  site,  and  analyst  *  site 
factors  are  tested  against  samples  (ana¬ 
lyst  y  site),  a  between-sample  error  term 
that  is  less  precise  than  the  within-sample 
comparisons.  Methods,  and  all  interac¬ 
tions  with  method,  are  tested  against 
experimental  error  Thus,  the  method 
comparisons  are  within-sample  compar¬ 
isons  and  are  more  precisely  determined 
than  site  and  analyst  comparisons 

The  estimate  of  experimental  error  (S;l 
is  0.01274  This  estimate  includes  varia¬ 
tion  resulting  from  single-analyst  preci¬ 
sion  as  well  as  other  factors  not  accounted 
for  in  the  model 

Ninety-five  percent  confidence  intervals 
on  the  actual  differences  for  both  sites 
can  now  be  calculated  by  using  the  ex¬ 
perimental  error  estimate 

Or  196v  2S:  30 

where  D  =  difference  in  site  means.  S-  ~ 
experimental  error,  and  30  =  number  of 
pairs  in  the  test  The  results  of  these 
calculations  are  given  m  Table  10 

A  pronounced  site  effect  is  evident  in 
the  magnitude  of  the  site  means  and  the 
interaction  of  siteand  method  as  indicated 
by  differences  in  the  effect  of  methods 
between  sites  The  method  difference  is 
due  to  the  prechlorination  site  alone  for 
w’hich  the  difference  is  0  14  mg  L  For  the 
postchlonnation  site,  the  observed  dif¬ 
ference  (0.03  ms  L|  has  95  percent  con 
fideore  intervals  that  include  0  heme 
the  hypothesis  of  equality  of  means  car.no: 
berere^fed.  Jn  this  case,  the  test  of  methods 
is  \r.  conclusive  despite  the  strong  method 


effect  in  the  ANOVA.  owing  to  the  inter¬ 
action  of  method  and  site 

The  estimated  experimental  error  of 
0.01274  would  suggest  a  minimum  de¬ 
tectable  difference  of  about  0.07  mg  L 
with  80  percent  power  This  indicates 
that  the  test  is  sensitive  to  small  differ¬ 
ences  in  the  method  means. 

Summary 

A  statistically  designed  experiment  for 
comparison  (equivalency)  testing  of  an¬ 
alytical  methods  used  at  water  treatment 
plants  has  been  developed.  The  design 
takes  into  account  the  variables  most 
often  encountered  in  routine  water  quality 
determinations.  This  design  should  allow 
for  the  testing  of  numerous  water  quality 
parameters  and  for  realistic  estimates  of 
single-analyst  precision  obtained  with 
minimum  involvement  of  any  one  treat¬ 
ment  plant.  It  is  possible  that  theestimates 
obtained  by  using  this  experimental  de¬ 
sign  are  the  best  approximation  of  what 
may  be  encountered  in  any  water  treat¬ 
ment  plant. 
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nnation  sites  if  prechlorination  wa* 
practiced.  Thus,  a  grand  total  of  192 
analyses  per  plant  was  obtained. 

For  the  alternative  test  procedure,  a 
FACTS  test  kit*  was  supplied  to  each 
water  treatment  plant  participating  in 
this  study.  The  DPD  or  amperomethc 
procedure  normally  used  at  each  plan 
served  as  the  standard  test  procedure. 

R— uttt  and  dtocutiion 

General  peMdperrts.  A  minimum  of  six 
participating  laboratories  is  necessary  to 
conduct  this  test,  and  these  must  be 
representative  and  geographically  dis¬ 
persed  water  treatment  plants  Sixteen 
plants  cooperated  in  this  particular  study. 
Ten  treatment  plants  provided  results 
obtained  with  the  DPD  and  FACTS 
methods,  and  six  plants  provided  results 
obtained  with  the  amperometric  titration 
and  FACTS  procedures. 

One  plant  provided  results  obtained 
with  the  DPD  and  FACTS  procedures  as 
well  as  a  single  amperometric  titration 
result  for  each  test  sample,  thus  allowing 
a  limited  three-way  comparison. 

Startettcal  mstftoda.  Although  the  design 
used  for  this  expenment  has  been  de¬ 
scribed  elsewhere.*  the  main  points  of  the 
analysis  are  described  here  for  clarity. 
The  single-analyst  precision  was  esti¬ 
mated  from  the  within-sample  variation 
(36  degrees  of  freedom)  for  each  location. 
Only  those  samples  with  multiple  deter¬ 
minations  (12  samples  with  four  mea¬ 
surements  by  each  method)  were  used  to 
determine  the  smgle-analyjt  precision. 
The  relative  magnitudes  of  precision  were 
expressed  as  percentages  (coefficients  of 
variation!  of  the  site  means  for  each 
location.  Finally,  the  variances  of  the  two 
methods  for  each  location  were  compared 
by  the  Fm„  statistical  test.*  For  this 
experiment,  an  F-value  of  2.49  or  greater 
was  required  to  reiect  the  hypothesis  of 
equality  of  variances  at  the  99  percent 
level  of  confidence.  This  analysis  com¬ 
pared  only  the  precision  of  the  methods. 

To  test  for  equivalency  of  methods,  an 
analysis  of  vanance  ( ANOVA)  procedure 
was  used.'  All  60  samples  were  used  in 
order  to  have  a  representative  range  of 
samples.  Multiple  determinations  were 
truncated  by  omitting  the  extra  observa¬ 
tions  and  retaining  only  the  first  deter¬ 
mination  by  each  method.  This  was  done 
because  multiple  determinations  do  not 
represent  true  replicates  of  the  methods, 
owing  to  carry-over  effects  from  previous 
observations  in  the  sequence.  Thus  varia¬ 
tion  among  repeated  observations  was 
not  considered  a  viable  estimate  of  ex¬ 
perimental  error.  The  ANOVA  table  for 
those  locations  with  no  missing  data  is 
given  in  Table  1 

The  error  mean  square,  i.e..  the  experi¬ 
mental  error  sum  of  squares  divided  by 
the  degrees  of  freedom,  was  used  to  test 
for  method  effect  and  to  estimate  the 
experimental  error  for  use  in  confidence 


limits.  The  method  companion  was  a 
within-sample  comparison  and.  thus,  not 
affected  by  sample-to-sample  variability. 
The  sample  means  could  therefore  vary 
considerably  from  day  to  day  without 
disturbing  the  comparison  of  methods. 
The  effects  of  analyst,  site,  and  analyst  x 
site  were  between-sample  effects  and 
therefore  not  precisely  determined  by 
this  experiment  because  variation  in 
sample  means  tends  to  inflate  the  error 
term  used  to  test  these  effects.  However, 
these  effects  were  less  important  than  the 
method  effect.  In  addition  the  interactions 
of  method  with  other  effects  were  also 
within-sample  comparisons  and  therefore 
also  tested  in  this  model  against  the  error 
mean  square.  The  analysis  was  analogous 
to  a  paired  t-test.  in  that  sample  variation 
was  removed  prior  to  comparison  of  the 
methods.  A  balanced  design  with  respect 
to  analyst  and  site  provided  additional 
information  beyond  a  simple  paired  t-test 
through  use  of  the  ANOVA  procedure  to 
analyze  the  other  factors  and  interactions 
in  the  model. 

Power  of  mo  method  comparisons-  Power 
refers  to  the  probability  of  reiecting  the 
hypothesis  of  equality  of  population 
means  or  to  the  sensitivity  of  the  statisti¬ 
cal  test.  Power  depends  in  part  on  the 
magnitude  of  the  experimental  error  rela¬ 
tive  to  the  true  difference  in  means  and  on 
the  sample  size.  In  general,  the  larger  the 
number  of  samples,  the  smaller  the  dif¬ 
ference  that  can  be  detected.  In  this  ex¬ 
periment  60  samples  were  taken.  30  from 
each  site  in  most  cases.  Power  calculations 
have  been  performed  for  a  range  of 
experimental  errors  *  From  these  calcula¬ 
tions  it  was  observed  that  the  expenment 
was  able  to  detect  small  differences  in  the 
method  means  (from  r 0.06  mg' L  to  rO  10 
mg'L  or  greater)  when  testing  at  a  0.05 
significance  level  with  80  percent  confi¬ 
dence.  Therefore,  in  this  study,  if  the  F- 
test  indicated  a  difference  in  the  method 
means,  the  actual  magnitude  of  the  mean 
differences  and  the  95  percent  confidence 
limits  on  the  differences  were  examined 
This  step  involved  scientific  judgment  as 
to  what  level  of  difference  was  opera¬ 
tionally  important  If  such  a  difference 
could  be  determined  before  the  experi¬ 
ment.  then  the  statistical  tests  could  be 
formulated  to  test  for  departures  from 
that  specified  value  rather  than  from  the 
zero  difference  value  generally  used.  It  is 
important  that  the  definition  if  opera¬ 
tionally  important  differences  be  deter¬ 
mined  prior  to  conducting  the  expenment 
to  avoid  biasing  the  definition  by  the 
experimental  outcome. 

DPD  and  FACTS 

Singte  analyst  prectwow  results.  Single- an¬ 
alyst  precision  is  the  standard  deviation 
of  repeated  measurements  made  on  a 
single  sample  by  a  single  analyst  under 
uniform  conditions.®  Table  2  lists  esti¬ 
mates  of  single-analyst  precision  within 
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The  ANOVA  table  for  testing  method  effects 
within  location 
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level  of  confidence  In  all  other  cases,  the 
methods  had  comparable  precision,  vary¬ 
ing  from  2.0  percent  to  18.9  percent  of  the 
respective  site  means.  In  one  case  ( location 
3)  the  estimate  of  precision  was  0.0 
because  all  repeated  observations  were 
the  same  for  the  giver  method  For  this 
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location,  no  comparison  of  precision  could 

be  madp 

Overall,  no  systematic  effect  was  ob¬ 
served  between  methods  sometimes 
FACTS  had  smaller  relative  percent  pre¬ 
cision  than  DPD  and  sometimes  it  did  not 

Equtealancy  leal  fsuta.  The  ANOVA  F- 


values  and  estimated  error  mean  squares 
( *  103)  for  the  comparison  of  the  DPD  and 
FACTS  test  procedures  are  reported  in 
Table  3.  For  all  results,  o  =  0  05  was  used 
as  the  level  of  significance.  A  consistent 
method  effect  was  detected  in  all  but  two 
cases  (locations  6  and  9).  Sporadic  inter¬ 
actions  of  method  with  other  factors  were 
detected,  but  in  general,  the  data  show- 
few  interactions.  A  pronounced  site  effect 
was  detected  in  four  of  the  eight  locations 
that  had  more  than  one  sampling  site 
Only  one  location  had  an  analyst  effect 
(location  4);  although  measurements  by 
analyst  2  tended  to  be  higher  than  those 
of  analyst  1.  no  effect  of  analyst  *  method 
was  detected  for  this  location,  indicating 
that  the  method  differences  were  com¬ 
parable  for  each  analyst.  A  puzzling 
reversal  of  the  relative  magnitudes  of  the 
method  means  across  the  two  sites  was 
detected  for  location  4  (Table  4).  making 
the  F-test  for  method  meaningless. 
Another  case  of  interaction  (method  * 
site  for  location  7)  also  resulted  in  a 
meaningless  F-test  for  method,  as  did  the 
interaction  of  method  *  analyst  at  location 
3.  Thus,  three  of  the  eight  cases  of 
statistically  significant  F-tests  for  method 
werestatistically  meaningless  becauseof 
interactions,  leaving  five  cases  of  method 
differences  Owing  to  previously  dis¬ 
cussed  considerations  of  the  power  or 
sensitivity  of  this  test,  however,  it  was 
necessary  to  evaluate  the  actual  magni¬ 
tude  of  the  mean  difference  for  each 
location  and  site. 

Table  4  shows  that  the  absolute  value 
of  the  method  differences  varied  from 
0.01  to  0.23  mg  Cl.  L  In  no  case  did  the 
upper  or  lower  95  percent  confidence 
limit  on  the  difference  in  means  exceed 
0  31  mg  L  in  absolute  value  To  illustrate 
the  spread  of  these  differences  a  graph  of 
DPD  versus  FACTS  mean  values  is  show  n 
in  Figure  1  The  45°  line  represents  no 
difference  in  means  This  graph  shows 
the  wide  range  of  sample  values  in  this 
experiment  The  dispersion  of  points 
above  and  below  the  line  indicates  no 
pronounced  bias  toward  either  method 
Because  the  original  F-tesf  is  extremeK 
sensitive  to  departures  from  this  45°  line 
a  further  analysis  was  performed  For 
each  site  the  individual  pairs  of  mean 
values  were  subjected  to  a  paired  f-iesf 
In  this  case  the  data  for  each  location 
were  reduced  to  a  mean  value  for  each 
method  at  each  site  Systematic  depar- 
*-  res  from  the  45°  line  were  then  tested 
across  locations  The  results  in  Table  5 
indicate  no  statistical  difference  between 
the  methods  at  the  prechlorination  site  |  p 
=  0.27|  and  marginal  difference  |p  = 
0  0421  at  the  postchlorination  site  Further 
the  95  percent  confidence  limits  on  the 
difference  |DPD  -  FACTS!  for  the  post- 
chlorination  site  were  from  near  0  0  to 
0  13  mg  L.  indicating  a  marginal  difference 
in  the  method  means  This  analysis  sup¬ 
ports  the  hypothesis  that  the  departures 
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are  due  to  chance  sample  deviations  of 
the  means  rather  than  to  a  systematic 
difference  between  methods. 

Amperomttric  titration  and  FACTS 

Singte-anatyst  prtdwow  reaults.  Estimates 
of  single-analyst  precision  within  each 
location  for  the  comparison  of  ampere- 
metric  titration  and  FACTS  are  listed  in 
Table  6.  In  three  cases  (locations  12.  14. 
and  15}.  a  difference  in  precision  was 
detected  at  the  99  percent  level  of  confi¬ 
dence.  At  location  12  the  FACTS  test  had 
a  single-analyst  precision  twice  that  of 
the  amperometric  titration.  At  location  14 
precision  with  the  FACTS  test  was  four 
times  higher  than  that  with  the  ampero¬ 
metric  titration  The  greatest  difference 
was  observed  at  location  15.  with  the 
single-analyst  precision  of  the  FACTS 
procedure  being  five  times  that  of  am¬ 
perometric  titration  In  all  cases  the 
magnitude  of  precision  was  <  10.9  percent 
of  the  mean,  and  the  absolute  magnitudes 
of  single-analyst  precision  were  all  <0.15 
mg  Cl.  L. 

Equivalency  test  results.  The  ANOVA  F- 
values  and  estimated  error  mean  squares 
(x  io3)  for  the  comparison  of  the  am¬ 
perometric  titration  and  FACTS  test  pro¬ 
cedures  are  reported  in  Table  7.  At  the 
0.05  level  of  significance,  a  method  effect 
was  detected  in  all  but  two  cases  (loca¬ 
tions  11  and  16).  Several  interactions  of 
method  with  other  factors  were  detected, 
but.  in  general,  the  data  show  few  inter¬ 
actions.  a  pattern  similar  to  that  found  in 
the  comparison  of  the  DPD  and  FACTS 
test  procedures  Of  the  four  locations  at 
which  the  procedures  were  tested  at  two 
sites,  three  showed  significant  site  effects. 
In  only  one  of  these  cases  was  an  interac¬ 
tion  of  method  *  site  detected  (location 
13).  Table  8  shows  that  at  this  location, 
there  was  nearly  a  fourfold  difference  in 
the  method  differences  between  the  two 
sites.  Thus,  no  clear  evaluation  of  methods 
was  possible  for  this  location. 

At  locations  15  and  16  variation  be¬ 
tween  analysts  and  interactions  of  method 
*  analyst  were  found.  For  location  15.  the 
method  effect  was  entirely  due  to  the 
second  analyst  (Table  9|.  Thus,  the  meth¬ 
od  effects  could  not  be  evaluated  An 
interaction  of  method  <  analyst  was  also 
found  at  location  16.  In  neither  case, 
however,  was  the  difference  due  to  meth¬ 
ods  significant  at  the  0.05  significance 
level. 

Thus,  a  method  difference  was  detected 
for  four  of  six  locations  Results  at  twoof 
these  locations  have  ambiguities  related 
either  to  site  or  to  analyst  interactions 
with  method.  For  neither  of  the  remaining 
two  locations  (locations  12  and  14)  at 
which  method  effects  were  clearly  indi¬ 
cated  did  the  upper  or  lower  95  percent 
confidence  bound  on  tne  difference  exceed 
0  31  mg  L  in  absolute  value  /Table  8). 

T o  illustrate  'he  spread  of  these  differ¬ 


ences.  a  graph  of  amperometric  titration 
versus  FACTS  mean  values  is  shown  in 
Figure  2.  Throughout  the  range  of  0.55  to 
2.7  mg  Clz  L  it  appears  that  the  results 
obtained  with  the  FACTS  procedure  were 
slightly  higher  than  those  obtained  by 
amperometric  titration;  i.e..  the  points  fall 
below  the  45°  line.  The  significance  of 
this  observation  was  tested  by  using  a 
paired  t-test  for  each  individual  pair  of 
mean  values  at  each  site.  The  results  in 
Table  10  indicate  no  statistical  difference 
between  the  methods  at  the  prechlorina¬ 
tion  site  (p  =  0.21 1  or  at  the  postchlonna- 
tion  site  (p  =  0.12)  The  95  percent  confi¬ 
dence  limits  on  the  differences  for  the 
prechlorination  and  postchlorination  sites 
include  aero:  therefore,  no  statistically 
significant  difference  was  detected  As 
was  the  case  for  the  comparison  of  the 
DPD  and  FACTS,  this  analysis  supports 
the  hypothesis  that  the  departures  of  the 
points  from  the  45°  line  in  Figure  2  are 
due  to  chance  sample  deviations  of  the 


means  rather  than  to  a  systematic  differ¬ 
ence  between  methods 

Amporomotric  titration,  DPD,  and 
FACTS 

At  location  6.  measurements  were  ob¬ 
tained  with  the  DPD  and  FACTS  test 
procedures,  and.  in  addition,  a  single 
measurement  of  each  sample  was  obtained 
by  using  amperometric  titration.  Single¬ 
analyst  precision  estimates  were  not 
possible  because  multiple  observations 
were  not  conducted  for  the  amperometric 
titration  method.  The  ANOVA  F-values 
for  the  three-way  comparison  are  sum¬ 
marized  in  Table  11.  The  only  effect 
detected  was  a  difference  in  methods  The 
observed  means  and  paired  mean  differ¬ 
ences  are  shown  in  Table  12. 

There  was  no  difference  detected  be¬ 
tween  the  DPD  and  FACTS  test  proce¬ 
dures.  The  amperometnc  titration  differed 
from  both  DPD  and  FACTS  test  proce¬ 
dures  at  the  0.05  level  of  significance  The 
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TABLE  9 

Analyst  and  method  effects  at  locations 
15  and  16 
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Await  a’  ‘  AMP*  T  FACTS  AMP  j  FACTS~ 

1  1  63  i  1  M  1  13  '  '20 

2  1  63  I  :  41  j  •  S?  j  '■  36 

*n  •  JO 

•  Amperemetr,.  •itranon 


TABLE  10 

Poired  t-test  results  for  the  comparison  of  amperometric  titration  and  FACTS  meons 
at  each  location  by  site  


AMP*  F  ACTS 


Difference 
.AMP  FACTSl 


Suabtr  oil  Standard  Error 
Patra  of  Dilfaranc* 


•J  Pm*m 
Confidence) 


T 


Pa  i  rad 
t-Taai 


Prachlonna'iof 

Poatchlorinatio 


’Amperometric  titration 


TABLE  12 

Paired  mean  difference  and  95  percent 
confidence  intervals  lor  the  three-way 
comparison  of  amperometric  titration. 
DPD.  and  FACTS 

TABLE  1 1 


**CTS  Moon  vaixoa-' »*  C  ,  t 


Maan  Valuaa 


Local  ton  j 

Symbol 

j  Amperometric 

1  Tilralion 

It 

0 

1  1  46 

1  46 

1  ’  " 

I  62 

12 

□ 

1  1  0? 

1  22 

11 

• 

2  06 

2  69 

o  *9  : 

0  96 

14 

A 

I  16  1 

1  61 

^  1  34 

1  *5 

13  ! 

0 

[  1M 

,  1  S4 

16 

0 

l  0  ss 

1  0  s# 

1  :  9*  ! 

1  =  ” 

Figure  2.  Comparison  of  means  for  free  avail¬ 
able  chlorine  obtained  with  FACTS  and 
amperomatnc  titration  at  s*x  water  treatment 
plants 


A  MOV  A  F-vaJues  for  experimental  factors 
in  the  comparison  of  the  amperometric 
titration  DPD  and  FACTS  test  procedures 


Factors 

0*9  re*  »  of  ! 

Freedom 

F- Value 

Rnaivti 

1  1 

0  63 

Sit* 

*  , 

0  0? 

An#ty»l  ■  tit* 

> 

0  03 

Method* 

2  1 

Me?- 

Method*  •  4n*J 

2  i 

0  2* 

Method*  •  »•'* 

2 

0  49 

Method*  ■  »n*  -  tntlvti 

*  1 

0  23 

Error  m*an  *q u •  r* '  -  in' 

112 

11  39 

*r  •  o  os 


Sum 

I  Sample 
Si*r 

AMP*  ; 

DPO 

1  FACTS 

Prechlorination 

30 

213  ; 

2  23 

2  26 

Potichlorination 

30  1 

it.  1 

i  23 

i  t» 

Ovtrall 

60 

»'•  1 

2  23 

2  2' 

Overall  Companaon 


Companaon 

I  M*4h 

Difference 

93  Percent  j 
'  Confidence  i 

Umn 

p-  Value 

DPO-  AMP 

0P9* 

'0  036  0  133lf 

0000; 

DPD-FACTS 

-0  035 

1-00*4  0  004- 

0  0** 

FACTS-AMP 

|  0  112 

|  lOOfJ  0  1*1  | 

o  ooo; 

’Amperometric  niranon 

TABLE  13 

Single-analyst  precision  as  percent  of 
the  mean  at  the  postrhlorination  site 


1 

Ran«*  of  | 

Number  of 

Sirvfle- Analytt  1 

Water 

Ten  Procedure  ! 

Precition 

Treatment  Plant* 

Amperometric  'urationl 

1  3-3  5 

6 

DPD  1 

2  0-14  6 

10 

FACTS 

0  0-14  0 

16 

absolute  magnitude  of  the  differences 
was  SO  17  mg  Cl,-  L  in  both  cases. 

These  data  allowed  a  three-way  com¬ 
parison  of  the  amperometric  titration. 
DPD  and  FACTS  test  procedures  How¬ 
ever.  because  this  comparison  was  tested 
at  only  one  location  without  replicate 
measurements,  no  generalized  conclu¬ 
sions  could  be  drawn  from  this  analysis 

Conclusions 

1  The  FACTS  and  DPD  tesv  proce¬ 
dures  for  measuring  free  chlorine  are 
equivalent 

2  The  FACTS  and  amperometric  test 
procedures  for  measuring  free  chlorine 
are  equivalent 

3  Single-analyst  precision,  expressed 
as  a  percent  nf  the  mean  at  the  postcnlo- 
nnation  site  for  each  test  procedure,  is 
summarized  in  Table  13 
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UNITED  STATES  ENVIRONMENTAL  PROTECTION  AGENCY 

°ATE  S£P  7  882 

subject  Nattonwide  Approval  of  Alternate  Test  Procedure  for  Free  Chlorine 
Residual,/’  /O 

F"0M  Victor  7  i re cT o r 1  ^ 

Office  of  Drilling  Water  (WH-550) 

T°  Regional  Administrators 


Listed  below  is  an  alternate  test  procedure  for  determining  free 
chlorine  residual  by  a  colorimetric  method  which  I  have  approved 
for  nationwide  use  for  "National  Interim  Primary  Drinking  Water 
Regulation"  ’(NIPDWR)  compliance  monitoring. 

The  principle  of  this  method  is  the  oxidation  of  syringaldazine 
(3 , 5-dimethoxy-4-hydroxy-benzaldazine)  by  free  available  chlorine 
on  a  1:1  molar  basis  to  produce  a  colored  complex  which  is  then 
measured  at  530  nm.  The  complete  method  write-up  is  provided  in 
the  15th  edition  of  "Standard  Methods  for  the  Examination  of  Water 
and  Wastewater",  pages  298-301.  A  report  entitled,  "Equivalency 
Testing  of  the  Free  Available  Chlorine  Test  with  Syringaldazine, 

FACTS"  indicates  that  this  method  is  comparable  to  the  USEPA 
approved  DPD  method  for  NIPDWR  compliance  monitoring. 

“-rcurcr.ant  Method 

Free  Chlorine  Residual  Method  408G  - 

"Syringaldazine  (FACTS)  Method" 

cc :  Robert  L.  Booth,  Acting  Director,  -EMSL 
Regional  Water  Supply  Representatives 
Regional  Quality  Assurance  Officers 
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